-- Logs begin at Fri 2022-07-15 16:52:02 UTC, end at Fri 2022-07-15 18:09:49 UTC. -- Jul 15 17:37:48.586530 dv-cinder-836973-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 17:37:48.595143 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 17:37:48 2022] *** Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: nodename: dv-cinder-836973-11-iscsi Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: machine: x86_64 Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: clock source: unix Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: pcre jit disabled Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: detected number of CPU cores: 4 Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: current working directory: / Jul 15 17:37:48.597184 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: detected binary path: /usr/bin/uwsgi-core Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: your processes number limit is 47680 Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: your memory page size is 4096 bytes Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: detected max file descriptor number: 2048 Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: lock engine: pthread robust mutexes Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: thunder lock: enabled Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 17:37:48.597897 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 17:37:48.637743 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: Python main interpreter initialized at 0x55cb9acf59c0 Jul 15 17:37:48.637743 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: python threads support enabled Jul 15 17:37:48.637743 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: your server socket listen backlog is limited to 100 connections Jul 15 17:37:48.637743 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: your mercy for graceful operations on workers is 90 seconds Jul 15 17:37:48.638103 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 17:37:48.638178 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: *** Operational MODE: preforking *** Jul 15 17:37:48.638406 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: *** uWSGI is running in multiple interpreter mode *** Jul 15 17:37:48.638406 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: spawned uWSGI master process (pid: 110186) Jul 15 17:37:48.638595 dv-cinder-836973-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 17:37:48.639270 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: spawned uWSGI worker 1 (pid: 110187, cores: 1) Jul 15 17:37:48.639562 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: spawned uWSGI worker 2 (pid: 110188, cores: 1) Jul 15 17:37:48.639668 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 17:37:49.299289 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 17:37:49.319493 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 17:37:50.385019 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:37:50.385019 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: from cryptography.utils import int_from_bytes Jul 15 17:37:50.385646 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:37:50.385646 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: from cryptography.utils import int_from_bytes Jul 15 17:37:50.386367 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:37:50.386367 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: from cryptography.utils import int_from_bytes Jul 15 17:37:50.386793 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:37:50.386793 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: from cryptography.utils import int_from_bytes Jul 15 17:37:52.840590 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 17:37:52.841284 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 17:37:52.841381 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 17:37:52.841705 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 17:37:52.841816 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 17:37:52.842181 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 17:37:52.842274 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 17:37:52.842359 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.842578 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 17:37:52.842681 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.842933 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.843028 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 17:37:52.843186 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 17:37:52.843281 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.843556 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.843649 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.843867 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.843962 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.844182 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.844275 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.844496 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.844629 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.844844 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.844938 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.845103 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.845250 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.845420 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.845513 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.845726 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-11-iscsi {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.845828 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846040 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846140 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846309 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846420 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846618 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846711 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.846927 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847019 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-11-iscsi {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847225 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847319 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847533 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847640 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847839 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.847940 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.848151 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.848327 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.848453 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.848787 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.848911 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.849083 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.849179 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.849385 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.849593 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.849815 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.849929 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850017 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850195 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850341 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850505 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850601 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850837 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.850939 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.851148 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.851241 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.851453 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.851549 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.851768 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.851862 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-11-iscsi {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.852072 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.852165 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.852390 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.852532 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.852720 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.852821 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.853135 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-11-iscsi {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.853238 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.853451 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.853537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.853759 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.853859 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.854067 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.854157 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.854381 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.854479 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.854684 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.854779 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855005 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855101 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855318 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855426 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855633 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855721 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.855946 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856032 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856243 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856364 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856549 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856669 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856879 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.856974 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.857192 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.857287 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.857491 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.857588 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.857794 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.857894 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858036 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858124 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858337 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858432 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858652 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858745 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.858969 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859063 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859215 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859307 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859518 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859617 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859764 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.859859 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860076 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860163 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860389 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860560 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860715 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860802 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.860965 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861054 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861284 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861373 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861592 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861685 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861892 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.861979 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.862192 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.862287 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.862492 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.862578 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.862788 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.862880 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863090 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863176 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863486 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863696 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863792 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.863998 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.864084 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.864312 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.864404 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.864639 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.864752 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.864954 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865039 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865256 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865352 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865573 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865674 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865889 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.865976 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.866191 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.866283 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.866496 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.866596 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.866807 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.866894 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.867108 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.867202 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.867410 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.867504 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.867710 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.867821 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.868023 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.868113 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.868333 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.868419 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.869181 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.869277 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.869444 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.869531 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.869742 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.869830 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870042 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870127 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870356 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870447 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870653 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870739 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.870953 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871040 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871254 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871353 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871546 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871631 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871847 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.871932 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.872148 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.872242 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.872447 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.872540 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.872769 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.872856 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873070 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873169 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873368 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873455 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873667 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873765 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.873966 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874065 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874268 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874359 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874572 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874668 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874877 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.874971 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.875177 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.875263 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.875476 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.875577 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.875773 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.875860 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.876071 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.876159 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.876386 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.876479 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.876710 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.876813 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877011 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877096 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877314 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877400 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877613 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877711 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.877912 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878052 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878215 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878301 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878514 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878613 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878814 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.878911 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.879113 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.879205 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.879410 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.879497 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.879710 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.879796 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880010 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880094 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880307 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880398 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880616 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880706 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.880922 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881068 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881222 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881317 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881518 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881606 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881816 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.881904 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.882111 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.882199 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.882408 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.882494 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.882701 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.882797 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883002 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883096 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883303 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883391 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883603 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883702 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883898 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.883983 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.884199 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.884285 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.884593 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.886994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.887100 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.887172 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.887248 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.887318 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.887384 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.887465 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.887539 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:37:52.887606 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.887671 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.887736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.887810 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888277 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888367 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888443 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888510 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888581 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888770 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888843 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888916 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888983 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.888983 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.889240 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.889319 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.889396 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.889462 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.889526 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.889589 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.890555 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.890662 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.890736 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.890802 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.890877 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891199 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891302 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891384 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891452 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891523 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891597 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891705 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891841 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.891959 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892088 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892223 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892347 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892490 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892683 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892835 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.892981 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.893121 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.893267 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.893409 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.893569 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.893715 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.893870 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894016 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894161 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894317 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894477 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894623 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894768 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.894924 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.895083 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.895250 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.895464 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.895614 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.895762 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.895906 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.896053 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.896219 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.896377 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.896524 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.896693 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.896859 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897016 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897177 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897335 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897479 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897627 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897782 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.897936 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.898100 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.898257 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.898403 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.898547 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.898703 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.898852 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899020 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899162 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899314 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899467 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899614 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899774 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.899923 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.900085 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.900225 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.900372 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.900517 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.900743 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.900905 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901057 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901202 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901348 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901491 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901658 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901806 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.901806 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902108 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902108 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902387 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902549 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902696 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902820 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.902976 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.903124 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.903291 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.903441 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.903601 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.903761 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.903918 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904078 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904234 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904386 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904821 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904909 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.904998 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905078 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905159 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905225 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905297 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905428 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905723 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.905929 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.906050 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.906274 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.906379 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.906580 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.906675 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.906887 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907017 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907193 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907294 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907494 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907580 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907799 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.907884 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.908106 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.908204 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.908408 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.908495 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.908744 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.908835 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909054 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909154 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909360 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909446 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909667 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909764 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.909977 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910075 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910298 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910395 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910595 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910685 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910912 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.910998 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.911229 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.911314 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.911539 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.911627 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.911839 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.911928 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.912145 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.912237 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.912443 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.912531 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.912769 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.912875 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913090 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913192 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913376 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913479 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913672 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913760 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.913969 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914055 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914266 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914368 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914568 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914653 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914866 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.914952 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.915169 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.915265 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.915472 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916092 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916285 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916370 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916710 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916904 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.916992 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.917216 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.917311 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.917518 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.917608 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.917820 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.917906 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.918121 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.918215 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.918460 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.918548 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.918764 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.918865 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919067 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919153 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919378 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919473 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919684 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919771 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.919991 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.920081 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.920297 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.920397 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.920641 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.920740 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.920937 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921040 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921243 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921331 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921555 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921648 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921857 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.921952 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.922172 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.922264 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.922474 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.922559 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.922787 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.922887 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.923085 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.923179 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.923396 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.923491 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.923700 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.923796 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924019 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924107 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924323 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924409 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924658 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924763 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.924970 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925058 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925280 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925367 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925585 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925673 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.925984 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.926193 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.926288 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.926498 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.926599 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.926803 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.926889 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.927104 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.927197 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.927410 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.927497 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.927709 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.927794 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928021 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928115 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928323 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928417 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928670 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928765 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.928954 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929048 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929262 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929350 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929565 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929657 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929881 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.929976 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.930183 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.930271 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.930487 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.930639 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.930801 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.930948 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.931092 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.931264 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.931964 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.932128 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.932263 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.932412 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.932548 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.932703 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.932885 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933024 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933186 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933322 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933490 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933636 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933776 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.933912 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934082 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934230 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934365 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934497 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934672 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934811 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.934961 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935105 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935246 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935381 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935543 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935687 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935832 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.935968 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.936147 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.936237 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.936447 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.936586 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.936771 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.936906 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937051 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937193 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937375 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937519 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937675 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937768 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.937989 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938077 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938293 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938394 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938591 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938680 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938888 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.938975 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.939186 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.939356 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.939500 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.939587 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.939803 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.939906 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.940099 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.940200 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.940397 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.940498 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.940735 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.940848 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941037 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941135 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941346 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941435 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941653 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941758 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.941958 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942057 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942261 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942355 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942567 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942653 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942869 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.942957 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.943173 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.943266 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.943475 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.943561 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.943781 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.943870 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.944086 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.944173 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.944397 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.944494 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.944723 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.944815 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945032 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945118 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945337 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945442 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945637 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945725 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.945942 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.946037 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.946247 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.946359 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.946557 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.946832 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.946930 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.947164 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.947253 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.947476 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.947567 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.947791 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.948044 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.948133 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.948384 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.948473 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.948727 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.948817 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949053 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949139 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949376 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949465 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949677 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949774 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.949981 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950068 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950283 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950380 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950581 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950676 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950889 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.950999 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.951185 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.951270 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.951486 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.951596 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.951781 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.951870 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.952083 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.952170 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.952381 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.952469 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.952705 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.952804 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953002 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953102 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953303 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953392 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953611 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953699 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.953909 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954005 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954208 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954295 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954504 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954597 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954814 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.954910 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.955117 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.955204 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.955412 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.955499 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.955711 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.955815 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956008 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956102 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956319 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956407 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956645 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956758 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.956951 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957039 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957253 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957345 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957595 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957695 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957899 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.957986 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.958198 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.958284 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.958517 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.958613 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.958816 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.958904 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.959115 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.959203 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.959422 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.959532 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.959721 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.959811 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960026 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960114 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960325 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960422 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960648 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960751 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.960958 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961076 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961264 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961363 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961565 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961661 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961864 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.961970 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.962169 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.962266 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.962490 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.962586 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.962797 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.962972 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.963099 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.963201 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.963398 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.963496 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.963696 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.963799 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964001 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964088 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964308 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964395 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964617 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964719 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.964928 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965022 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965226 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965312 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965536 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965623 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965832 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.965918 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.966132 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.966226 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.966431 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.966519 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.966736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.966838 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967038 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967134 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967332 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967428 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967632 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967732 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.967938 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968037 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968237 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968326 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968535 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968880 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.968983 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.969177 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.969283 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.969475 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.969567 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.969778 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.969877 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.970095 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.970185 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.970404 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.970489 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.970698 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.970795 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971073 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971179 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971296 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971383 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971593 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971690 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971892 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.971981 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.972193 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.972280 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.972488 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.972577 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.972810 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.972899 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973106 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973195 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973402 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973491 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973698 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973793 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.973998 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974087 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974300 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974387 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974596 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974681 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974896 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.974984 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.975190 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.975278 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.975505 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.975592 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.975806 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.975901 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.976106 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.976192 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.976407 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.976494 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.976784 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.976906 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.977098 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.977195 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.977405 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.977494 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.977712 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.977872 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.978014 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.978659 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.978827 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.978915 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.979136 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.979234 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.979440 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.979746 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.979841 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980044 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980133 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980340 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980435 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980676 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980813 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.980986 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981077 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981277 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981362 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981570 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981657 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981892 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.981980 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.982198 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.982291 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.982495 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.982581 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.982796 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.982885 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.983099 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.983189 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.983402 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.983491 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.983703 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.983792 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984004 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984307 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984401 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984617 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984705 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.984929 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985016 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985233 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985332 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985538 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985624 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985836 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.985920 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.986138 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.986254 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.986440 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.986535 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.986737 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.986824 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987041 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987147 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987344 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987439 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987640 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987726 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.987937 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988024 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988232 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988325 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988535 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988642 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988858 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.988948 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.989161 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.989278 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.989463 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.989582 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.989769 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.989885 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.990068 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.990180 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.990482 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.990577 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.990786 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.990883 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.991088 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.991399 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.991539 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.991755 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.991755 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992013 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992013 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992267 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992407 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992563 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992760 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.992891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993027 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993161 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993294 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993436 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993570 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993704 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.993875 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994011 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994145 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994287 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994434 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994582 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994716 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994852 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.994993 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.995136 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.995308 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.995445 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.995611 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.995752 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.995924 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.996057 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.996233 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.996378 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.996551 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.996706 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.996877 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.997016 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.997180 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.997322 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.997591 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.997694 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.997901 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998035 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998204 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998292 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998516 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998616 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998833 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.998921 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.999132 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.999219 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.999440 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.999540 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.999743 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:52.999856 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.000059 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.000149 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.000375 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.000469 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.000701 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.000811 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001008 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001098 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001305 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001453 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001623 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001800 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.001930 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002047 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002235 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002321 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002533 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002651 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002852 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.002942 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.003171 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.003257 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.003482 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.003571 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.003801 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.003887 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.004133 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.004221 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.004433 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.004530 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.004765 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.004855 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005068 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005154 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005370 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005459 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005667 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005758 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.005982 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006078 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006279 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006366 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006582 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006670 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006882 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.006976 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.007179 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.007265 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.007475 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.007561 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.007769 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.007898 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.008078 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.008194 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.008378 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.008454 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.008723 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.008879 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.009017 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.009151 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.009826 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.009966 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.010112 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.010204 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.010437 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.010514 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.010745 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.010821 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.011044 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.011347 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.011418 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.011485 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.011626 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.012810 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014358 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014471 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014547 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014627 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014697 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014764 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014764 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014902 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.014969 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.015034 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.015107 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.016404 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.016559 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.016741 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.016878 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017017 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017160 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017315 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017467 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017607 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017744 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.017883 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018019 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018169 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018169 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018428 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018566 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018706 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018844 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.018993 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.019132 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.019281 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.019419 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.019564 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.019712 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.019859 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020014 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020146 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020283 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020419 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020565 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020749 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.020903 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021042 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021183 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021326 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021469 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021611 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021753 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.021895 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022038 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022177 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022320 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022455 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022590 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022738 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.022957 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.023106 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.023294 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.023506 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.023718 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.023913 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.024149 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.024303 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.024448 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.024584 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.024739 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.024886 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.025582 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.025730 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.025869 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026003 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026140 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026275 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026418 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026568 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026705 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026845 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.026981 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027115 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027270 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027406 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027406 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027662 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027812 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.027949 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028097 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028240 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028378 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028463 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028544 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028651 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028753 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028837 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.028920 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029006 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029087 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029087 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029239 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029321 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029400 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029478 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029563 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029563 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029716 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029797 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029875 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.029954 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030032 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030200 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030285 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030366 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030445 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030524 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030610 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030691 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030770 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030849 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.030916 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031043 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031207 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031340 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031431 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031652 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031748 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.031984 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.032089 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.032303 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.032392 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.032634 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.032726 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033007 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033109 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033274 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033361 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033589 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033687 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033887 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.033976 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.034196 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.034283 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.034505 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.034602 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.034815 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.034911 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.035208 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.035315 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.035414 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.035498 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.035724 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.035812 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036032 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036127 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036334 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036423 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036662 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036752 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.036973 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037059 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037283 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037371 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037591 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037678 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037899 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.037995 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.038209 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.038298 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.038551 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.038691 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.038838 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.038986 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.039125 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.039262 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.039451 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.039598 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.039766 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.039911 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.040080 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.040226 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.040392 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.040526 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.040880 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.040973 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.041193 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.041332 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.041505 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.041669 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.041827 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.041921 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.042126 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.042214 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.042425 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.042521 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.042727 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.042816 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043027 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043185 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043322 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043412 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043636 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043733 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.043939 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044037 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044236 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044333 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044546 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044666 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044872 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.044960 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.045183 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.045393 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.045483 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.045742 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.045831 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.046053 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.046140 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.046371 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.046595 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.046683 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.046940 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047027 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047257 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047353 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047574 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047661 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047874 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.047961 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.048175 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.048271 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.048484 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.048571 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.048814 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.048905 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.049113 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.049203 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.049412 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.049501 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.049716 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.049804 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050019 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050116 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050317 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050405 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050617 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050704 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.050913 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051001 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051222 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051360 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051516 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051661 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.051939 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.052097 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.052188 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.052402 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.052551 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.052706 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.052844 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053007 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053169 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053348 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053525 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053680 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053796 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053880 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.053960 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.054158 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.054257 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.054548 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.054755 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.054849 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055054 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055143 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055350 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055437 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055652 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055742 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.055951 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.056041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.056282 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.056369 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.056585 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.056696 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.056908 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057005 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057218 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057308 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057520 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057609 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057834 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.057924 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.058132 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.058218 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.058432 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.058533 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.058735 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.058822 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059053 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059141 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059360 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059572 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059671 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059898 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.059988 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.060212 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.060308 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.060537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.060830 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.060921 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.061169 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.061315 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.061467 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.061568 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.061768 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.061857 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.062086 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.062175 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.062392 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.062481 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.062695 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.062783 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063001 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063089 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063307 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063396 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063610 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063704 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.063914 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064002 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064216 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064306 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064533 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064659 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064847 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.064944 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.065150 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.065245 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.065452 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.065548 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.065757 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.065859 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066058 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066145 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066363 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066448 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066669 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066766 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.066973 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.067062 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.067280 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.067367 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.067587 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.067686 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.067896 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068046 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068199 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068287 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068501 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068591 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068831 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.068955 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.069133 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.069213 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.069443 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.069543 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.069748 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.069851 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070055 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070160 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070355 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070452 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070662 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070756 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.070988 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.071095 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.071299 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.071408 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.071601 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.071690 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.072468 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.072572 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.072807 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.072936 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.073123 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.073253 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.073427 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.073570 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.073740 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.073878 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.074043 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.074197 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.074365 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.074517 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.074694 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.074826 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075014 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075146 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075332 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075454 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075634 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075780 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.075932 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.076113 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.076233 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.076441 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.076530 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.076790 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.076880 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.077097 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.077186 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.077400 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.077487 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.077701 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.077797 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078001 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078089 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078298 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078385 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078595 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078682 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.078893 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079002 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079191 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079286 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079489 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079583 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079782 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.079879 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080078 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080175 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080374 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080488 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080690 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080787 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.080985 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081072 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081279 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081398 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081580 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081686 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081871 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.081956 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.082167 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.082260 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.082470 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.082554 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.082757 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.082860 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083050 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083146 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083348 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083433 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083652 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083751 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.083949 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084045 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084397 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084548 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084667 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084890 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.084984 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.085192 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.085279 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.085504 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.085599 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.085823 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.085918 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.086129 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.086215 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.086426 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.086527 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.086744 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.086831 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.087046 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.087131 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.087349 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.087444 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.088201 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.088305 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.088510 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.088624 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.088840 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089013 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089147 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089235 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089468 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089555 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089789 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.089886 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.090090 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.090178 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.090402 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.090494 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.090756 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.090857 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091024 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091118 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091331 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091417 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091636 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091797 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.091950 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.092093 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.092247 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.092385 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.092532 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.092762 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.092898 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093034 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093169 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093316 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093449 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093538 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093759 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.093857 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094063 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094161 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094368 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094458 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094674 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094761 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.094980 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095076 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095292 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095380 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095600 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095697 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095904 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.095993 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.096219 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.096305 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.096534 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.096658 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.096889 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.096988 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.097192 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.097280 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.097512 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.097599 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.097835 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.097924 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098141 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098447 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098542 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098747 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098845 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.098986 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 17:37:53.099097 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.099431 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.099741 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.100051 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.100354 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:37:53.100613 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 17:37:53.159853 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO dbcounter [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Registered counter for database nova_api Jul 15 17:37:53.161604 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO dbcounter [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Registered counter for database nova_api Jul 15 17:37:53.272625 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_db.sqlalchemy.engines [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.274163 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_db.sqlalchemy.engines [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.279177 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writer thread running {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.280585 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writer thread running {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.334458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.context [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f200e8f4-cedd-42b3-a7df-f4992185efad(cell1) {{(pid=110188) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 17:37:53.335692 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.context [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f200e8f4-cedd-42b3-a7df-f4992185efad(cell1) {{(pid=110187) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 17:37:53.338468 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:37:53.339653 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_concurrency.lockutils [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:37:53.340017 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:37:53.340871 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:37:53.341241 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_concurrency.lockutils [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:37:53.342033 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_concurrency.lockutils [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:37:53.342927 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:37:53.344141 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_concurrency.lockutils [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:37:53.344902 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO dbcounter [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Registered counter for database nova_cell0 Jul 15 17:37:53.346145 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO dbcounter [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Registered counter for database nova_cell0 Jul 15 17:37:53.348709 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO dbcounter [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Registered counter for database nova_cell1 Jul 15 17:37:53.349909 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO dbcounter [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Registered counter for database nova_cell1 Jul 15 17:37:53.355889 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_db.sqlalchemy.engines [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.357749 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_db.sqlalchemy.engines [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.359462 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_db.sqlalchemy.engines [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.360827 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writer thread running {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.361468 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_db.sqlalchemy.engines [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.365461 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writer thread running {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.368407 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writer thread running {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.501894 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writer thread running {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.510777 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO dbcounter [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Registered counter for database nova_cell0 Jul 15 17:37:53.513424 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO dbcounter [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Registered counter for database nova_cell0 Jul 15 17:37:53.519812 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_db.sqlalchemy.engines [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.523617 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG oslo_db.sqlalchemy.engines [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:37:53.524363 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writer thread running {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.528908 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writer thread running {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:37:53.944164 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: WARNING keystonemiddleware.auth_token [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:37:53.951490 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: WARNING keystonemiddleware.auth_token [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:37:53.982008 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: WARNING keystonemiddleware.auth_token [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:37:53.989418 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: WARNING keystonemiddleware.auth_token [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:37:54.294868 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: WARNING keystonemiddleware.auth_token [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:37:54.300987 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: WARNING keystonemiddleware.auth_token [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:37:54.306294 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb9acf59c0 pid: 110188 (default app) Jul 15 17:37:54.308366 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:37:54.309585 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 Jul 15 17:37:54.310001 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Fri Jul 15 17:37:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:37:54.331015 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: WARNING keystonemiddleware.auth_token [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:37:54.337090 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: WARNING keystonemiddleware.auth_token [None req-ad39d4fc-2d64-4ea3-9ccf-54074de7ae5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:37:54.342849 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb9acf59c0 pid: 110187 (default app) Jul 15 17:39:13.538173 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:13.540991 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Jul 15 17:39:13.540991 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:13.561113 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writing DB stats nova_api:SELECT=3 {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:13.562000 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writing DB stats nova_cell0:SELECT=3 {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:13.562861 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writing DB stats nova_cell1:SELECT=3 {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:13.563700 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:14.414632 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-0bf483e4-dbe2-4335-8681-fad8cbd7b81c admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:14.444428 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-0bf483e4-dbe2-4335-8681-fad8cbd7b81c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892383 Jul 15 17:39:14.445032 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 15 17:39:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:16.659730 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:16.660618 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-889fb1c2-5307-4d26-be25-cc1b86218656 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Jul 15 17:39:16.662966 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:17.150152 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-50521ace-71af-488a-9dc0-a6abdb39ffcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:17.168498 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:39:17.168498 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: warnings.warn(msg) Jul 15 17:39:17.252031 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-50521ace-71af-488a-9dc0-a6abdb39ffcc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.584678 Jul 15 17:39:17.258005 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:17.270869 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_api:SELECT=3 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:17.272163 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_cell0:SELECT=3 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:17.273087 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_cell1:SELECT=3 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:17.273947 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:17.500402 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-fc8b09cf-e93a-43bc-be6c-a70f60925c10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:17.502766 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:39:17.502766 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: warnings.warn(msg) Jul 15 17:39:17.622131 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-fc8b09cf-e93a-43bc-be6c-a70f60925c10 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360297 Jul 15 17:39:17.636639 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 15 17:39:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:19.936492 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-50521ace-71af-488a-9dc0-a6abdb39ffcc admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:19.939233 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-50521ace-71af-488a-9dc0-a6abdb39ffcc admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003257 Jul 15 17:39:19.939850 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:20.630647 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-1a60820e-a9e8-47d5-aa13-4447dd7a28c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:20.651377 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:39:20.651377 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: warnings.warn(msg) Jul 15 17:39:20.772327 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-1a60820e-a9e8-47d5-aa13-4447dd7a28c8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.824862 Jul 15 17:39:20.773142 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:20.785477 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-7df71202-8cd7-413c-84f4-d53e0cfa15ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:20.787340 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:39:20.787340 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: warnings.warn(msg) Jul 15 17:39:20.877342 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-7df71202-8cd7-413c-84f4-d53e0cfa15ab admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095621 Jul 15 17:39:20.878108 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 15 17:39:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:23.073613 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-1a60820e-a9e8-47d5-aa13-4447dd7a28c8 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:23.074651 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-1a60820e-a9e8-47d5-aa13-4447dd7a28c8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 15 17:39:23.075438 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:23.478467 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f38c564a-a60c-441e-be57-f6149045175f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:23.559110 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f38c564a-a60c-441e-be57-f6149045175f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478131 Jul 15 17:39:23.559659 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 17:39:23.572518 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-250e98e1-ba9d-4b3f-9d04-02111c8ee49e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:23.648554 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-250e98e1-ba9d-4b3f-9d04-02111c8ee49e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080436 Jul 15 17:39:23.649185 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 15 17:39:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:25.846791 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f38c564a-a60c-441e-be57-f6149045175f admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:25.847740 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f38c564a-a60c-441e-be57-f6149045175f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 15 17:39:25.848145 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:26.293757 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-e425cc63-6bdd-4163-9331-6a6022867ae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:26.373401 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-e425cc63-6bdd-4163-9331-6a6022867ae8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518795 Jul 15 17:39:26.373950 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:26.386374 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-bf6299ce-5388-4db6-b9d6-0743511cd810 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:26.481795 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-bf6299ce-5388-4db6-b9d6-0743511cd810 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099207 Jul 15 17:39:26.482308 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 15 17:39:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:39:28.689946 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-e425cc63-6bdd-4163-9331-6a6022867ae8 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:28.691550 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-e425cc63-6bdd-4163-9331-6a6022867ae8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jul 15 17:39:28.698166 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:29.123796 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-9db7246c-c92d-45e7-adff-1d86d4636745 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:29.204914 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-9db7246c-c92d-45e7-adff-1d86d4636745 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504881 Jul 15 17:39:29.205866 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:29.218485 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-c9f676a2-1d98-4d6d-9754-c1b8f1cbf40d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:29.312357 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-c9f676a2-1d98-4d6d-9754-c1b8f1cbf40d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097756 Jul 15 17:39:29.312993 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 15 17:39:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:31.566897 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-9db7246c-c92d-45e7-adff-1d86d4636745 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:31.568009 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-9db7246c-c92d-45e7-adff-1d86d4636745 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 15 17:39:31.568415 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:31.989998 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-f53ea0a7-426c-4e29-9f34-2ead7539e439 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:32.014137 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-f53ea0a7-426c-4e29-9f34-2ead7539e439 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438545 Jul 15 17:39:32.014950 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 15 17:39:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:39:34.719823 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-9db7246c-c92d-45e7-adff-1d86d4636745 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:34.721551 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-9db7246c-c92d-45e7-adff-1d86d4636745 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002383 Jul 15 17:39:34.722312 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:35.184191 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-a89008f7-f3f5-4030-9ac0-323e3728e751 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "ram": 512}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:35.292011 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-a89008f7-f3f5-4030-9ac0-323e3728e751 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.561709 Jul 15 17:39:35.295352 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:35.305273 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-5a05b533-c163-43f5-a16d-efeca016ecd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:35.428126 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-5a05b533-c163-43f5-a16d-efeca016ecd8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126605 Jul 15 17:39:35.428711 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 15 17:39:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:37.606221 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-a89008f7-f3f5-4030-9ac0-323e3728e751 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:37.607227 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-a89008f7-f3f5-4030-9ac0-323e3728e751 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 15 17:39:37.607622 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:37.997748 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-150c18cf-5c71-43f5-8df7-b3caac23dc93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "disk": 20, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:38.107666 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-150c18cf-5c71-43f5-8df7-b3caac23dc93 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494050 Jul 15 17:39:38.108215 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:38.120865 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-43b52ceb-4413-40c5-9f66-17b061511c6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:38.214391 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-43b52ceb-4413-40c5-9f66-17b061511c6e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097203 Jul 15 17:39:38.215093 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 15 17:39:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:40.419515 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-150c18cf-5c71-43f5-8df7-b3caac23dc93 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:40.420529 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-150c18cf-5c71-43f5-8df7-b3caac23dc93 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 15 17:39:40.420967 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:40.793082 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-9406359d-c116-4755-980a-d8b01983755f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:40.874023 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-9406359d-c116-4755-980a-d8b01983755f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.447091 Jul 15 17:39:40.874485 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:40.886918 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-2eee5ebb-38b6-4bf4-b96a-372d33754e41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:40.945578 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-2eee5ebb-38b6-4bf4-b96a-372d33754e41 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062656 Jul 15 17:39:40.946196 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 15 17:39:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:43.285956 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-9406359d-c116-4755-980a-d8b01983755f admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:43.286977 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-9406359d-c116-4755-980a-d8b01983755f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 15 17:39:43.287376 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:43.879938 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-903c6a48-5fe3-4d93-a993-9bcdc212c1bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "disk": 80}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:43.886031 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:44.073788 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-903c6a48-5fe3-4d93-a993-9bcdc212c1bb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.778774 Jul 15 17:39:44.074652 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:44.087990 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-50585543-8b16-434d-8276-26bebed57816 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:44.174944 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-50585543-8b16-434d-8276-26bebed57816 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091722 Jul 15 17:39:44.175557 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 15 17:39:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:39:46.409670 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-903c6a48-5fe3-4d93-a993-9bcdc212c1bb admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:39:46.410684 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-903c6a48-5fe3-4d93-a993-9bcdc212c1bb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 15 17:39:46.411085 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:39:46.853220 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-79d37386-0c91-4f8d-b61e-4a5716d1f9cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:46.907108 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-79d37386-0c91-4f8d-b61e-4a5716d1f9cd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490233 Jul 15 17:39:46.907939 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 15 17:39:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:39:46.919682 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-c304a400-ef45-415c-9e03-78822bc410bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:39:46.989990 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-c304a400-ef45-415c-9e03-78822bc410bd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073818 Jul 15 17:39:46.994363 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 15 17:39:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:40:07.458410 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-79d37386-0c91-4f8d-b61e-4a5716d1f9cd admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:07.460005 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-79d37386-0c91-4f8d-b61e-4a5716d1f9cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jul 15 17:40:07.460441 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:07.854366 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-4e33a935-1aa6-4508-aa33-997dea8c2e49 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:07.870909 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-4e33a935-1aa6-4508-aa33-997dea8c2e49 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404613 Jul 15 17:40:07.871438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 15 17:40:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:40:08.934936 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-79d37386-0c91-4f8d-b61e-4a5716d1f9cd admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:08.935931 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-79d37386-0c91-4f8d-b61e-4a5716d1f9cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 15 17:40:08.937354 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:09.452901 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-0eb2d6fb-cc3e-4fd9-8df9-e9a2313d1898 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:09.458667 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.wsgi [None req-0eb2d6fb-cc3e-4fd9-8df9-e9a2313d1898 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-0eb2d6fb-cc3e-4fd9-8df9-e9a2313d1898 admin admin] Request method failure captured: Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Accept: application/json Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Accept-Encoding: gzip, deflate Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Connection: keep-alive Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Content-Length: 0 Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Host: 10.222.0.57 Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Openstack-Api-Version: compute 2.90 Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Openstack-System-Scope: None Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: User-Agent: python-novaclient Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Auth-Token: gAAAAABi0aZ4oWuS7PnXZPPWvjNDAYdoNQ5YORHBxpahMhscAxj2aSQCdP6PE4fhKo9d_bGBggzEIuu3OoNv84B6QraVsTsaNb_pcpTFF_sss9lIlRyq1uy1kD_frzsbI4pYtaxxvhgPoojanBeWp0woHv_QrppIs7CkqDdZ9Dnso1P7YtOFMzo Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Domain-Id: None Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Domain-Name: None Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Identity-Status: Confirmed Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Is-Admin-Project: True Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Domain-Id: default Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Domain-Name: Default Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Name: admin Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Role: admin,reader,member Jul 15 17:40:09.462393 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Roles: admin,reader,member Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ce7dfbb170044b796f3aa09ded4d2e4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}] Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant: admin Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant-Name: admin Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User: admin Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Domain-Id: default Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Domain-Name: Default Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Id: 4a4044f3af624daa8f53a39108ebc20d Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Name: admin Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: method: > Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: exception: Flavor 42 could not be found. Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: action_args: {'id': '42'} Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:40:09.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:09.469643 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.471070 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-0eb2d6fb-cc3e-4fd9-8df9-e9a2313d1898 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:40:09.472389 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-0eb2d6fb-cc3e-4fd9-8df9-e9a2313d1898 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391447 Jul 15 17:40:09.472389 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 15 17:40:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:09.473370 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-af5fa610-3b13-4944-b39a-3dcc210fa5b7 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:09.476366 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:09.494914 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-af5fa610-3b13-4944-b39a-3dcc210fa5b7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025025 Jul 15 17:40:09.497301 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 15 17:40:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:40:09.506136 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-73c853f7-c232-45e5-aec1-9b61ccb99130 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:09.527745 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-73c853f7-c232-45e5-aec1-9b61ccb99130 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026131 Jul 15 17:40:09.528276 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 15 17:40:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:40:09.538381 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-947fb8ef-a3d9-4409-bbfa-ca1d3e6510b5 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:09.544429 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.wsgi [None req-947fb8ef-a3d9-4409-bbfa-ca1d3e6510b5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-947fb8ef-a3d9-4409-bbfa-ca1d3e6510b5 admin admin] Request method failure captured: Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Accept: application/json Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Accept-Encoding: gzip, deflate Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Connection: keep-alive Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Content-Length: 0 Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Host: 10.222.0.57 Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Openstack-Api-Version: compute 2.90 Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Openstack-System-Scope: None Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: User-Agent: python-novaclient Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Auth-Token: gAAAAABi0aZ4oWuS7PnXZPPWvjNDAYdoNQ5YORHBxpahMhscAxj2aSQCdP6PE4fhKo9d_bGBggzEIuu3OoNv84B6QraVsTsaNb_pcpTFF_sss9lIlRyq1uy1kD_frzsbI4pYtaxxvhgPoojanBeWp0woHv_QrppIs7CkqDdZ9Dnso1P7YtOFMzo Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Domain-Id: None Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Domain-Name: None Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Identity-Status: Confirmed Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Is-Admin-Project: True Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Domain-Id: default Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Domain-Name: Default Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Name: admin Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Role: admin,reader,member Jul 15 17:40:09.547700 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Roles: admin,reader,member Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ce7dfbb170044b796f3aa09ded4d2e4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}] Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant: admin Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant-Name: admin Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User: admin Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Domain-Id: default Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Domain-Name: Default Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Id: 4a4044f3af624daa8f53a39108ebc20d Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Name: admin Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: method: > Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: exception: Flavor 42 could not be found. Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: action_args: {'id': '42'} Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:40:09.555594 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:09.556584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:09.557891 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-947fb8ef-a3d9-4409-bbfa-ca1d3e6510b5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:40:09.559180 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-947fb8ef-a3d9-4409-bbfa-ca1d3e6510b5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014916 Jul 15 17:40:09.559180 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 15 17:40:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:10.519822 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-73c853f7-c232-45e5-aec1-9b61ccb99130 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:10.520872 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-73c853f7-c232-45e5-aec1-9b61ccb99130 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 15 17:40:10.521767 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:11.044400 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-0916486a-d184-4a21-ae4c-bb042ee682ee admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:11.050507 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.wsgi [None req-0916486a-d184-4a21-ae4c-bb042ee682ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-0916486a-d184-4a21-ae4c-bb042ee682ee admin admin] Request method failure captured: Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Accept: application/json Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Accept-Encoding: gzip, deflate Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Connection: keep-alive Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Content-Length: 0 Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Host: 10.222.0.57 Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Openstack-Api-Version: compute 2.90 Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Openstack-System-Scope: None Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: User-Agent: python-novaclient Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Auth-Token: gAAAAABi0aZ6YrTEj1GZRbn5KkI8EMYrajzAEU3krRMSsw5GgSMKshkgxWL5B8rqBp3M1DefBkcTUHI6-Q1_OvnCmCLFTu1NY3AXQ6ySIBCMffwUZ5w0_vF8IjhLz2vQQqJVRSb4MYhz100ycAscsT7g20ZNsl8Y84cu2DTtwEQHAy1GAJK7U_w Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Domain-Id: None Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Domain-Name: None Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Identity-Status: Confirmed Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Is-Admin-Project: True Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Domain-Id: default Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Domain-Name: Default Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Name: admin Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Role: admin,reader,member Jul 15 17:40:11.052041 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Roles: admin,reader,member Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ce7dfbb170044b796f3aa09ded4d2e4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}] Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant: admin Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant-Name: admin Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User: admin Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Domain-Id: default Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Domain-Name: Default Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Id: 4a4044f3af624daa8f53a39108ebc20d Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Name: admin Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: method: > Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: exception: Flavor 84 could not be found. Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: action_args: {'id': '84'} Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:40:11.053584 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:11.054458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.055537 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-0916486a-d184-4a21-ae4c-bb042ee682ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:40:11.056552 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-0916486a-d184-4a21-ae4c-bb042ee682ee admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396032 Jul 15 17:40:11.056552 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 15 17:40:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:11.063303 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-8945c192-fc06-40d2-9b4f-2a69c1e193bc admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:11.077476 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-8945c192-fc06-40d2-9b4f-2a69c1e193bc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017811 Jul 15 17:40:11.078013 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 15 17:40:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:40:11.087913 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-1f4a40c0-d860-4146-9d6d-9bb885e5f2cf admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:11.101532 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-1f4a40c0-d860-4146-9d6d-9bb885e5f2cf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017709 Jul 15 17:40:11.102061 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 15 17:40:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:40:11.111453 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-d278e52c-4506-4a85-acea-1762cdc76265 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:11.116751 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.wsgi [None req-d278e52c-4506-4a85-acea-1762cdc76265 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-d278e52c-4506-4a85-acea-1762cdc76265 admin admin] Request method failure captured: Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Accept: application/json Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Accept-Encoding: gzip, deflate Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Connection: keep-alive Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Content-Length: 0 Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Host: 10.222.0.57 Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Openstack-Api-Version: compute 2.90 Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Openstack-System-Scope: None Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: User-Agent: python-novaclient Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Auth-Token: gAAAAABi0aZ6YrTEj1GZRbn5KkI8EMYrajzAEU3krRMSsw5GgSMKshkgxWL5B8rqBp3M1DefBkcTUHI6-Q1_OvnCmCLFTu1NY3AXQ6ySIBCMffwUZ5w0_vF8IjhLz2vQQqJVRSb4MYhz100ycAscsT7g20ZNsl8Y84cu2DTtwEQHAy1GAJK7U_w Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Domain-Id: None Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Domain-Name: None Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Identity-Status: Confirmed Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Is-Admin-Project: True Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Domain-Id: default Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Domain-Name: Default Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Name: admin Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Role: admin,reader,member Jul 15 17:40:11.118251 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Roles: admin,reader,member Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ce7dfbb170044b796f3aa09ded4d2e4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}] Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant: admin Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant-Name: admin Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User: admin Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Domain-Id: default Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Domain-Name: Default Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Id: 4a4044f3af624daa8f53a39108ebc20d Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Name: admin Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: method: > Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: exception: Flavor 84 could not be found. Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: action_args: {'id': '84'} Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:40:11.119786 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:11.120902 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:11.122229 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-d278e52c-4506-4a85-acea-1762cdc76265 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:40:11.123468 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-d278e52c-4506-4a85-acea-1762cdc76265 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011796 Jul 15 17:40:11.123468 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 15 17:40:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:12.081972 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-1f4a40c0-d860-4146-9d6d-9bb885e5f2cf admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:12.082968 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-1f4a40c0-d860-4146-9d6d-9bb885e5f2cf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 15 17:40:12.083360 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:12.600314 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-e0b21afe-a91c-470a-9740-11a814c4aad1 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:12.606082 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.wsgi [None req-e0b21afe-a91c-470a-9740-11a814c4aad1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-e0b21afe-a91c-470a-9740-11a814c4aad1 admin admin] Request method failure captured: Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Accept: application/json Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Accept-Encoding: gzip, deflate Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Connection: keep-alive Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Content-Length: 0 Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Host: 10.222.0.57 Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Openstack-Api-Version: compute 2.90 Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Openstack-System-Scope: None Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: User-Agent: python-novaclient Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Auth-Token: gAAAAABi0aZ7cgYn3mCA4SyGnP-6QMLmDXrEp9A4mM5LWKCFFLUwbYPKQwdmTbWX9AnoCUI6w6IjE4QtPaF8xilUc58fnv8NbSXTn8hOJM7gv88EOJexT7pVf3dkJ58znGNbu0CH_S5oexYc2JRQ83-iq8-RW0DOxIp-rcIQBapUqW4uQO6dAoE Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Domain-Id: None Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Domain-Name: None Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Identity-Status: Confirmed Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Is-Admin-Project: True Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Domain-Id: default Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Domain-Name: Default Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Project-Name: admin Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Role: admin,reader,member Jul 15 17:40:12.607566 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Roles: admin,reader,member Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ce7dfbb170044b796f3aa09ded4d2e4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}] Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant: admin Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-Tenant-Name: admin Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User: admin Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Domain-Id: default Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Domain-Name: Default Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Id: 4a4044f3af624daa8f53a39108ebc20d Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: X-User-Name: admin Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: method: > Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: exception: Flavor 451 could not be found. Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: action_args: {'id': '451'} Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:40:12.609099 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:12.610091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.611438 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-e0b21afe-a91c-470a-9740-11a814c4aad1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:40:12.612682 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-e0b21afe-a91c-470a-9740-11a814c4aad1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389547 Jul 15 17:40:12.612682 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 15 17:40:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:12.618624 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-101babbb-7a6d-4aa0-b0e7-2a14f0f9be7a admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:12.632503 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-101babbb-7a6d-4aa0-b0e7-2a14f0f9be7a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017481 Jul 15 17:40:12.633054 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 15 17:40:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:40:12.642518 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:12.657691 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018974 Jul 15 17:40:12.658216 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 15 17:40:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:40:12.667328 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-e77250d6-d901-4db6-a450-622fb2ee4a13 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:12.672615 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.wsgi [None req-e77250d6-d901-4db6-a450-622fb2ee4a13 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-e77250d6-d901-4db6-a450-622fb2ee4a13 admin admin] Request method failure captured: Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Accept: application/json Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Accept-Encoding: gzip, deflate Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Connection: keep-alive Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Content-Length: 0 Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Host: 10.222.0.57 Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Openstack-Api-Version: compute 2.90 Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Openstack-System-Scope: None Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: User-Agent: python-novaclient Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Auth-Token: gAAAAABi0aZ7cgYn3mCA4SyGnP-6QMLmDXrEp9A4mM5LWKCFFLUwbYPKQwdmTbWX9AnoCUI6w6IjE4QtPaF8xilUc58fnv8NbSXTn8hOJM7gv88EOJexT7pVf3dkJ58znGNbu0CH_S5oexYc2JRQ83-iq8-RW0DOxIp-rcIQBapUqW4uQO6dAoE Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Domain-Id: None Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Domain-Name: None Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Identity-Status: Confirmed Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Is-Admin-Project: True Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Openstack-Nova-Api-Version: 2.90 Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Domain-Id: default Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Domain-Name: Default Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Project-Name: admin Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Role: admin,reader,member Jul 15 17:40:12.674119 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Roles: admin,reader,member Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6ce7dfbb170044b796f3aa09ded4d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6ce7dfbb170044b796f3aa09ded4d2e4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6ce7dfbb170044b796f3aa09ded4d2e4"}]}] Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant: admin Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant-Id: 6ce7dfbb170044b796f3aa09ded4d2e4 Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-Tenant-Name: admin Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User: admin Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Domain-Id: default Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Domain-Name: Default Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Id: 4a4044f3af624daa8f53a39108ebc20d Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: X-User-Name: admin Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: method: > Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: exception: Flavor 451 could not be found. Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: action_args: {'id': '451'} Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:40:12.675628 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:12.676736 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: ERROR nova.api.openstack.wsgi Jul 15 17:40:12.677994 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-e77250d6-d901-4db6-a450-622fb2ee4a13 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:40:12.679276 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-e77250d6-d901-4db6-a450-622fb2ee4a13 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011651 Jul 15 17:40:12.679276 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 15 17:40:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 15 17:40:13.644119 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:13.645147 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 15 17:40:13.645541 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:14.187612 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-9445d3c8-ca54-4b6b-b956-e96c5b4a164a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:40:14.272927 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-9445d3c8-ca54-4b6b-b956-e96c5b4a164a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.489911 Jul 15 17:40:14.273470 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 15 17:40:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:40:15.237006 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:15.238062 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 15 17:40:15.238448 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:40:15.762328 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-62a5052e-bab2-45a9-9693-bff07eb2eaa8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:40:15.826331 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-62a5052e-bab2-45a9-9693-bff07eb2eaa8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.452004 Jul 15 17:40:15.826943 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 15 17:40:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:40:16.793282 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:16.794293 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 15 17:40:16.794683 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:17.323458 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-3173cdb1-36ad-4504-9974-5736e98e3762 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:40:17.402576 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-3173cdb1-36ad-4504-9974-5736e98e3762 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.469258 Jul 15 17:40:17.403164 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 15 17:40:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:40:18.381812 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:18.382892 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 15 17:40:18.383422 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:18.912976 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-6523c20b-9d0f-4190-8dae-f157e113d80c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:40:18.987324 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-6523c20b-9d0f-4190-8dae-f157e113d80c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.466912 Jul 15 17:40:18.987864 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 15 17:40:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:40:19.981744 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:19.982819 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 15 17:40:19.983211 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:40:20.515349 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-bbc89ecd-35d2-49ee-a04e-61c1496bbd1e admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:40:20.534670 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-bbc89ecd-35d2-49ee-a04e-61c1496bbd1e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402479 Jul 15 17:40:20.535198 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Fri Jul 15 17:40:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:41:11.877158 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:41:11.878692 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-f9fd6bb0-1cf2-4304-8c76-09d6608c7729 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 15 17:41:11.879091 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 15 17:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:41:11.889645 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:12.269052 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-19259eb4-8bc8-4c11-bc19-5e1c93d09ec5 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:41:12.288044 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-19259eb4-8bc8-4c11-bc19-5e1c93d09ec5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403114 Jul 15 17:41:12.288578 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 15 17:41:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:41:12.311517 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-939f8224-0c1d-4cdc-9fea-129c45131657 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:41:12.314970 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG dbcounter [-] [110187] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:12.319926 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-939f8224-0c1d-4cdc-9fea-129c45131657 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012089 Jul 15 17:41:12.328012 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Fri Jul 15 17:41:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:41:12.332278 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-1baca403-3c0b-437f-92e5-91ff8c1da0ed admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:41:12.340142 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-1baca403-3c0b-437f-92e5-91ff8c1da0ed admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011915 Jul 15 17:41:12.340688 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Fri Jul 15 17:41:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:41:12.353058 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:41:12.360699 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011211 Jul 15 17:41:12.361214 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Fri Jul 15 17:41:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:41:12.372715 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-493ad221-46ad-4d1a-8391-43cefd7a58e0 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:41:12.380852 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-493ad221-46ad-4d1a-8391-43cefd7a58e0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011721 Jul 15 17:41:12.381380 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Fri Jul 15 17:41:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:45:03.038985 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:03.039990 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 15 17:45:03.040377 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:45:03.179991 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_api:SELECT=6 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:03.323402 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-f7f3a3e5-8b3d-44bf-a97d-696d21585451 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:03.324675 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:45:03.324675 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: warnings.warn(msg) Jul 15 17:45:03.325946 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-f7f3a3e5-8b3d-44bf-a97d-696d21585451 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:03.326388 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-f7f3a3e5-8b3d-44bf-a97d-696d21585451 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:03.327204 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-f7f3a3e5-8b3d-44bf-a97d-696d21585451 admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:03.327682 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-f7f3a3e5-8b3d-44bf-a97d-696d21585451 admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:03.361946 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-f7f3a3e5-8b3d-44bf-a97d-696d21585451 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.183977 Jul 15 17:45:03.362512 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 15 17:45:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:45:04.217237 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:04.218302 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 15 17:45:04.218719 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:45:04.421191 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-a7a69dc9-150a-46e9-8e86-a2950b532ffb admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:04.422404 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:45:04.422404 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: warnings.warn(msg) Jul 15 17:45:04.423565 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-a7a69dc9-150a-46e9-8e86-a2950b532ffb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:04.424009 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-a7a69dc9-150a-46e9-8e86-a2950b532ffb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:04.424823 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-a7a69dc9-150a-46e9-8e86-a2950b532ffb admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:04.425258 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-a7a69dc9-150a-46e9-8e86-a2950b532ffb admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:04.444307 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-a7a69dc9-150a-46e9-8e86-a2950b532ffb admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075006 Jul 15 17:45:04.444913 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 15 17:45:04 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:45:15.713875 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:15.714924 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 15 17:45:15.715314 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:45:15.859378 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_cell0:SELECT=4 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:15.860093 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_cell1:SELECT=4 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:15.860725 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG dbcounter [-] [110188] Writing DB stats nova_api:SELECT=8 {{(pid=110188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:15.910532 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-fd2ce9b4-e0d4-44c4-8e34-812c624e10a1 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:15.911691 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:45:15.911691 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: warnings.warn(msg) Jul 15 17:45:15.912905 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-fd2ce9b4-e0d4-44c4-8e34-812c624e10a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:15.913350 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-fd2ce9b4-e0d4-44c4-8e34-812c624e10a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:15.914160 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-fd2ce9b4-e0d4-44c4-8e34-812c624e10a1 admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:15.914593 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-fd2ce9b4-e0d4-44c4-8e34-812c624e10a1 admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:15.949003 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-fd2ce9b4-e0d4-44c4-8e34-812c624e10a1 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.093670 Jul 15 17:45:15.950496 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 15 17:45:15 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:45:16.788782 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: DEBUG nova.api.openstack.wsgi [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] Calling method '>' {{(pid=110187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:16.789844 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: INFO nova.api.openstack.requestlog [None req-14ef1444-1593-41b8-80ca-b457757e17c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 15 17:45:16.790268 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: [pid: 110187|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 15 17:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:45:16.979541 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG nova.api.openstack.wsgi [None req-911db618-b9b3-44ab-9399-3a53e7d0b1f2 admin admin] Calling method '>' {{(pid=110188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:45:16.980737 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:45:16.980737 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: warnings.warn(msg) Jul 15 17:45:16.982534 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-911db618-b9b3-44ab-9399-3a53e7d0b1f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:16.982976 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-911db618-b9b3-44ab-9399-3a53e7d0b1f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:16.983771 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-911db618-b9b3-44ab-9399-3a53e7d0b1f2 admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:45:16.984200 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: DEBUG oslo_concurrency.lockutils [None req-911db618-b9b3-44ab-9399-3a53e7d0b1f2 admin admin] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:45:17.005473 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: INFO nova.api.openstack.requestlog [None req-911db618-b9b3-44ab-9399-3a53e7d0b1f2 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076858 Jul 15 17:45:17.006022 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: [pid: 110188|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 15 17:45:16 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:46:15.030028 dv-cinder-836973-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 15 17:46:15.036537 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: Fri Jul 15 17:46:15 2022 - graceful shutdown triggered... Jul 15 17:46:15.037163 dv-cinder-836973-11-iscsi devstack@n-api.service[110187]: Gracefully killing worker 1 (pid: 110187)... Jul 15 17:46:15.037526 dv-cinder-836973-11-iscsi devstack@n-api.service[110188]: Gracefully killing worker 2 (pid: 110188)... Jul 15 17:46:16.031895 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: worker 1 buried after 1 seconds Jul 15 17:46:16.031895 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: worker 2 buried after 1 seconds Jul 15 17:46:16.031895 dv-cinder-836973-11-iscsi devstack@n-api.service[110186]: goodbye to uWSGI. Jul 15 17:46:16.033571 dv-cinder-836973-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 15 17:46:16.034126 dv-cinder-836973-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 15 17:46:16.036873 dv-cinder-836973-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 15 17:46:16.046269 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 15 17:46:16.048839 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 17:46:16 2022] *** Jul 15 17:46:16.048993 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 17:46:16.049129 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 17:46:16.049358 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: nodename: dv-cinder-836973-11-iscsi Jul 15 17:46:16.049494 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: machine: x86_64 Jul 15 17:46:16.049605 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: clock source: unix Jul 15 17:46:16.049826 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: pcre jit disabled Jul 15 17:46:16.049951 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: detected number of CPU cores: 4 Jul 15 17:46:16.050060 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: current working directory: / Jul 15 17:46:16.050166 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: detected binary path: /usr/bin/uwsgi-core Jul 15 17:46:16.050279 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: your processes number limit is 47680 Jul 15 17:46:16.050387 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: your memory page size is 4096 bytes Jul 15 17:46:16.050525 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: detected max file descriptor number: 2048 Jul 15 17:46:16.050525 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: lock engine: pthread robust mutexes Jul 15 17:46:16.050746 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: thunder lock: enabled Jul 15 17:46:16.050894 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 15 17:46:16.051112 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 17:46:16.091800 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: Python main interpreter initialized at 0x560c224649c0 Jul 15 17:46:16.091800 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: python threads support enabled Jul 15 17:46:16.091800 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: your server socket listen backlog is limited to 100 connections Jul 15 17:46:16.091800 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: your mercy for graceful operations on workers is 90 seconds Jul 15 17:46:16.092228 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 17:46:16.092228 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: *** Operational MODE: preforking *** Jul 15 17:46:16.092633 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: *** uWSGI is running in multiple interpreter mode *** Jul 15 17:46:16.092633 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: spawned uWSGI master process (pid: 124732) Jul 15 17:46:16.092709 dv-cinder-836973-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 15 17:46:16.092942 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: spawned uWSGI worker 1 (pid: 124743, cores: 1) Jul 15 17:46:16.093266 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: spawned uWSGI worker 2 (pid: 124745, cores: 1) Jul 15 17:46:16.093504 dv-cinder-836973-11-iscsi devstack@n-api.service[124732]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 17:46:16.763595 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 17:46:16.773955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 15 17:46:17.938738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:46:17.938738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: from cryptography.utils import int_from_bytes Jul 15 17:46:17.939413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:46:17.939413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: from cryptography.utils import int_from_bytes Jul 15 17:46:17.999534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:46:17.999534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: from cryptography.utils import int_from_bytes Jul 15 17:46:18.000121 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:46:18.000121 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: from cryptography.utils import int_from_bytes Jul 15 17:46:20.269657 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 17:46:20.270206 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 17:46:20.270457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 17:46:20.270824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 17:46:20.271088 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 17:46:20.271484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.271818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.272146 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.272473 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.272926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.273247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.273574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.273903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.274239 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.274506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.274825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.275155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-11-iscsi {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.275483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.275795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.276144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.276468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.276803 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.277147 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.277444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.277942 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.279310 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.279310 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.279310 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.279708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.279945 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.280275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.280590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.280945 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.281254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.281573 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.281972 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-11-iscsi {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.282299 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.282613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.282934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.283355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.283666 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.283975 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.284301 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.284655 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.284969 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.285298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.285621 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.285971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.286269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.286578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.286892 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.287206 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.287532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.287842 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.288151 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.288413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.288748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.289076 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.289408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.289737 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.289993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.290246 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.290573 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.290905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.291217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.292041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.292374 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.292715 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.293029 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.293340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.293653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.293963 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.294285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.294605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.294931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.295242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.295565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.296006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.296217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.296527 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.296896 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.297218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.297604 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.297847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.298172 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.298508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.298789 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.299099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.299422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.299763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.300071 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.300326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.300650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.301030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.301285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.301594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.301904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.302212 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.302518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.302826 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.303135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.303442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.303750 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.304058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.304364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.304698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.305010 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.305319 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.305641 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.305962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.306272 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.306580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.306890 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.307266 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.308108 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.308421 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.308794 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.309082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.309395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.309703 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.313597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.315602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.316944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.316944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.316944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.317362 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.317661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.318277 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.318922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.319772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.319958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.320252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.320629 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.320969 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.321302 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.321626 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.321953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.322288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.322610 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.322962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.323281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.323809 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.323982 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.324333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.324566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.324914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.325243 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.325562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.325888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.326224 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.326556 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.327747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.327747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.327747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.328235 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.328235 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.328525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.328813 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.329131 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.329446 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.329775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.330122 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.330441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.330765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.331081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.331398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.331712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.332028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.332345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.332706 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.333028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.333347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.333735 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.334092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.334286 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.334648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.334922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.335231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.335540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.335849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.336161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.336468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.336818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.337149 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.337461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.337802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.338113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.338449 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.338768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.339092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.339390 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.339706 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.340028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.340339 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.340711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.341001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.341312 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.341639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.341949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.342258 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.342574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.342888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.343201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.343517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.343839 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.344198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.344464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.344823 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.345162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.345496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.345806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.346137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.346467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.346791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.347099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.347430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.347717 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.348025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.348337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.348672 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.348986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.349292 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.349597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.349912 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.350220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.350550 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.350866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.351172 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.351480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.351788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.352137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.352449 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.352837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.353181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.353511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.353961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.354855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.355096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.355297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.355617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.355936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.356254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.356581 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.356922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.357248 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.357567 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.357898 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.358215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.358541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.358852 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.359174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.359522 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.359860 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.360184 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.360520 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.360960 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.361198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.361513 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.361832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.362150 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.362468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.362794 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.363111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.363433 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.363751 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.364085 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.364395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.364905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.365104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.365378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.365714 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.365878 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 17:46:20.366369 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.366527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 17:46:20.366675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.366675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.367082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 17:46:20.367264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.367413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 17:46:20.367413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 17:46:20.367688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.367688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.367988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.368136 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.368290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.368435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.368581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.368808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.368972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.369137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.369292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.369438 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.369675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.370423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.370586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.370733 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.370878 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.371041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.371273 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.371439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.371600 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.371757 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.371915 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.372068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.372221 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-11-iscsi {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.372367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.372525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.372692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.372853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.373007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.373152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.373623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.373789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.373936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.374108 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.374431 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.374587 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.374741 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.374916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.375242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.375242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.375628 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.375801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.375963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.376120 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.376274 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.376431 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.376578 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.376770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.376933 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.377106 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.377338 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.377497 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.377645 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.377789 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.378017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.378174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.378422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.378583 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.378744 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.378897 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.379053 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.379200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.379353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-11-iscsi {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.379499 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.379677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.379898 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.380051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.380205 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.380359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.380505 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.380699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.380855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.381000 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.381145 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.381306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.381538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.381700 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.381854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.382008 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.382155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.382568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.382720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.382886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.383052 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.383207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.383361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.386641 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.386889 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.387062 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.387225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.387497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.387656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.387816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.387976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.388127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.388127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.388440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.388619 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.388775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.388935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.389090 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.389239 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.389401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.389548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.389692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.389879 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.390121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390282 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.390440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.391424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.391695 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.391849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.391996 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.392151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.392312 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.392458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.392675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.392840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.392988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.393143 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.393297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.393451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.393604 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.393749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.393901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.394062 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.394233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.394492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.395251 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.395421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.395585 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.395741 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.395899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.396054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.396674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.396843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.397003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.397151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.397303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.397488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.397734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.398011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.398192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.398350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.398504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.398659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.398805 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.398951 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.399106 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.399252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.399396 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.399550 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.399719 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.399876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.400022 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.400371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.400523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.400712 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.400863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.401155 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.401315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.401462 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.401606 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.401849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.402002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.402171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.402323 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.402468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.402613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.402889 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.403057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.403216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.403389 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.403614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.403788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.403938 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.404092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.404256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.404402 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.404547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.404746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.404900 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.405069 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.405222 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.405391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.405553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.405714 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.405874 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.406037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.406190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.406587 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.406910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.407084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.407238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.407404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.407558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.407558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.407946 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.408113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.408279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.408440 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.408630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.408802 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.409032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.409191 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.409358 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.409511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.409670 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.409838 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.409991 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.410150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.410317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.410676 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.410840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.411013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.411348 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.411536 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.411763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.412010 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.412171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.412407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.412571 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.412773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.412935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.413096 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.413260 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.413427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.413580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.413739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.413904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.414063 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.414225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.414378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.414529 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.414687 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.414847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.414999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.415159 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.415331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.415492 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.415652 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.415824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.415977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.416139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.416291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.416461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.418177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.418385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.418556 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.418725 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.418886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.419038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.419197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.419358 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.419533 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.419686 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.419846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.419846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.420135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.420287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.420472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.420843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.421015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.421176 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.421328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.421479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.421640 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.421805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.421805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.422222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.422383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:46:20.422543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.422712 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.422866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423335 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423663 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.423981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.424143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.424296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.424463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.424644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.424806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.424957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.425118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.425279 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.425442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.425595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.425764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.425936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.426097 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.426256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.426454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.426682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.426844 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.427006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.427181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.427424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.427591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.427751 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.428194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.428441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.428660 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.428835 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429474 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.429958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.430110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.430269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.430421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.430421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.430732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431040 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431514 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431838 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.431998 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.432219 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.433058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.433058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.433986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.434148 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.434315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.434474 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.434474 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.434768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.434935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.435088 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.435240 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.435399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.435560 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.435722 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.435888 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.436048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.436219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.436381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.436533 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.436736 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.436901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.437052 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.437212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.437390 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.437625 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.437799 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.437960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.438383 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.438632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.438815 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.438969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.439131 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.439283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.439283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.439572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.439729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.439906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.440073 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.440233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.440393 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.440557 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.440778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441307 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441785 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441947 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.441947 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.442294 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.442457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.442457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.442747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.442907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.443092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.443333 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.443492 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.443654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.443814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.443981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.444143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.444303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.444455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.444635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.444796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.444961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.445122 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.445293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.445447 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.445606 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.445606 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.445914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.446068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.446228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.446389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.446541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.446701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.446879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.447033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.447195 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.447367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.447528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.447854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.448037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.448220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.448740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.448910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.449073 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.449242 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.449404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.449558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.449710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.449870 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.450037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.450264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.450420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.450580 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.450733 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.450885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.451175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.451352 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.451507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.451659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.451659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.451948 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.452127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.452289 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.452449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.452631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.452791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.452944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.453110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.453271 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.453513 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.453680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.453842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454167 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454330 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454482 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454795 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.454956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.455120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.455120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.455420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.455581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.455741 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.455909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.456115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.456283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.456455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.456636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.456815 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.456984 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.457138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.457291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.457291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.457588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.457588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.458044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.458044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.458364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.458364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459203 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459520 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.459975 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.460137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.460947 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.461262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.461477 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.461655 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.461809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.461969 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.462365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.462539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.462709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.462872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.463026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.463178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.463330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.463552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.463818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.463993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.464159 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.464319 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.464481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.464799 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.464962 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.465115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.465274 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.465274 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.465572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.465740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.465898 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466360 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466360 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466582 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466702 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.466930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467169 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467526 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.467769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.468012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.468220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.468545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.468980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.474174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.474374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.474535 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.474865 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475046 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475236 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475433 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.475988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476173 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476461 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476827 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.476928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477111 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477280 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477719 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477817 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.477987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478373 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.478859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.479763 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.479866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.479966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480054 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480147 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480241 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480782 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480867 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.480963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481475 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481564 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481842 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.481928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482094 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482094 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482259 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482351 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482711 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482804 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482896 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.482981 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483065 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483148 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483592 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483784 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.483875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484221 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484306 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484861 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.484959 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485053 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485316 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485757 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.485943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486223 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486306 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.486924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487275 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487702 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487878 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.487961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488403 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488671 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488826 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.488921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489086 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489180 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489279 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489373 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.489950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490426 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490512 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490606 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490784 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490784 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.490923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491291 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491746 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491838 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.491942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492029 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492121 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492208 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.492934 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493319 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493761 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.493935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.495877 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.495983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496061 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496212 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496294 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496726 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496823 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.496991 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497078 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497159 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497608 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497785 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497785 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.497949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498289 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498535 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498607 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498687 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.498932 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499090 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499170 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499243 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499322 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499402 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.499946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500165 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500471 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500547 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.500916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501136 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501289 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501289 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501289 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501559 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501651 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501864 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501940 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.501940 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502088 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502168 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502239 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.502939 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503377 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.503916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.504015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.504112 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.504491 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.504633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.505795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.505939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.505939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506094 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506335 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506335 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506822 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.506920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.507157 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.507261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.507745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.507848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.508064 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.508158 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.508402 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.508498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.508747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.508845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.509066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.509177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.509385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.509479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.509708 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.509801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510022 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510131 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510364 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510474 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.510992 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.511096 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.511304 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.511397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.511621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.511722 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.511931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.512036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.512238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.512331 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.512553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.512673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.512980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513287 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513859 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.513955 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.514188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.514283 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.514545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.514653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.514805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.514903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.515124 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.515224 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.515434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.515541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.515747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.515842 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.516059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.516161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.516374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.516469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.516715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.516817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517345 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517786 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.517972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.518118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.518284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.518453 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.518598 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.518776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.518906 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.519110 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.519233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.519443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.519547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.519775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520591 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520803 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.520943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.521152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.521267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.521572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.521733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.521913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.522990 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.523210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.523320 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.523538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.523632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.523854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.523947 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.524171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.524324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.524482 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.524812 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.524927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525555 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.525862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.526584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.526689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.526904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527311 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527531 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527844 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.527946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.528158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.528333 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.528472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.528567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.528818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.528921 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.529138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.529246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.529451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.529544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.529762 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.529857 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.530074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.530178 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.530391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.530549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.530702 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.530862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.531043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.531175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.531386 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.531486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.531711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.531805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.532043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.532145 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.532365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.532466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.532728 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.532828 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.533041 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.533135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.533370 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.533485 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.533693 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.533788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534327 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534726 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.534974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.535068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.535269 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.535371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.535588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.535705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.535938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.536048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.536224 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.536422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.536526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.536776 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.536885 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.537092 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.537215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.537414 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.537530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.537743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.537865 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538360 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538522 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538846 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.538980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.539166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.539285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.539503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.539598 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.539824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.539919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.540152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.540254 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.540470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.540566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.540818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.540916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.541131 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.541239 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.541438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.541613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.542300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.542406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.542611 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.542719 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.542934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543028 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543693 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.543989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.544203 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.544298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.544527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.544668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545004 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545302 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.545863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.546114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.546230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.546419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.546523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.546743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.546837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.547074 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.547166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.547347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 17:46:20.547442 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.547702 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.548036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.548361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.548725 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.549060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.549392 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.549700 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.550008 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.550318 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.550625 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.550929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.551359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.551674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.551980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.552284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.552588 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.552943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.553249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.553572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.553883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.554187 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.554493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.554798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.555140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.555441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.555774 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.556154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.556411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.556768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.557084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.557762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.557762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.558050 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.558366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.558683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.559002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.559324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.559644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.560040 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.560263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.560642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.560918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.561496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.561828 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.562147 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.562464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.562777 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.563095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.563411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.563732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.564046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.564358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.564697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.565036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.565368 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.565717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.566035 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.566361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.566679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.567186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.567503 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.567871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.568195 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.568506 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.568870 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.569191 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.569515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.569830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.570148 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.570465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.570779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.571091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.571403 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.571718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.572033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.572365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.572730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.573092 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.573411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.573731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.574054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.574633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.574954 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.575312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.575621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.575949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.576267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.576589 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.576956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.577267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.577576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.577892 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.578207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.578514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.578839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.579152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.579465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.579787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.580099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.580714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.581068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.581389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.581719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.582048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.582366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.582976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.583308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.583622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.583934 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.584258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.584570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.584976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.585218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.585538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.585865 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.586156 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.586469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.586774 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.587108 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.587419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.587727 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.588035 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.588353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.589227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.589535 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.589904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.590154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.590469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.590776 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.591088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.591394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.591707 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.592015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.592326 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.592789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.593127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.593438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.593746 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.594070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.594390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.594715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.595026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.595342 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.595696 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.596017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.596636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.596988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.597312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.597661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.598002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.598315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.598628 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.598941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.599270 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.599586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.599909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.600223 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.600536 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.600880 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.601195 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.601508 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.601820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.602133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.602445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.602757 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.603068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.603380 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.603702 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.604747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.605261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.605586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.605908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.606230 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.606545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.606858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.607173 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.607483 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.607801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.608138 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.608455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.608801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.609241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.609558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.609882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.610211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.610526 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.610853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.611179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.611496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.611820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.612132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.612465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.612836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.613172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.613498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.613809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.614116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.614422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.614733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.615054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.615365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.615671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.615981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.616293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.616624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.616925 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.617231 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.617536 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.617844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.618151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.618456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.618762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.619068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.619374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.619719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.620043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.620350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.620675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.620983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.621289 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.621595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.621942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.622309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.622596 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.622922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.623238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.623562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.623873 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.624198 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.624521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.624872 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.625182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.625513 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.625826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.626142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.626505 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.626765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.627074 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.627390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.627723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.628052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.628362 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.628713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.629036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.629610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.629951 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.630272 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.630600 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.630917 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.631232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.631544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.631857 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.632172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.632782 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.633100 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.633415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.633733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.634051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.634382 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.634709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.635019 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.635377 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.635707 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.636065 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.636723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.636723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.637067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.637496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.637698 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.638007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:46:20.638253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 17:46:20.699160 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO dbcounter [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Registered counter for database nova_api Jul 15 17:46:20.722080 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_db.sqlalchemy.engines [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.730741 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writer thread running {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:20.787227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.context [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f200e8f4-cedd-42b3-a7df-f4992185efad(cell1) {{(pid=124745) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 17:46:20.789359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO dbcounter [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Registered counter for database nova_api Jul 15 17:46:20.791237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:46:20.793593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:46:20.794398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:46:20.796391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:46:20.798398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO dbcounter [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Registered counter for database nova_cell0 Jul 15 17:46:20.802509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO dbcounter [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Registered counter for database nova_cell1 Jul 15 17:46:20.809714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_db.sqlalchemy.engines [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.810997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_db.sqlalchemy.engines [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.813208 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_db.sqlalchemy.engines [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.816532 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writer thread running {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:20.817910 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writer thread running {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:20.823677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writer thread running {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:20.873319 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.context [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f200e8f4-cedd-42b3-a7df-f4992185efad(cell1) {{(pid=124743) load_cells /opt/stack/nova/nova/context.py:464}} Jul 15 17:46:20.877522 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:46:20.879126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:46:20.879938 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:46:20.881974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:46:20.884247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO dbcounter [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Registered counter for database nova_cell0 Jul 15 17:46:20.888422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO dbcounter [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Registered counter for database nova_cell1 Jul 15 17:46:20.895833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_db.sqlalchemy.engines [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.898063 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_db.sqlalchemy.engines [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.903402 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writer thread running {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:20.966952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO dbcounter [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Registered counter for database nova_cell0 Jul 15 17:46:20.974366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_db.sqlalchemy.engines [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:20.979589 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writer thread running {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:21.044440 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writer thread running {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:21.058282 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO dbcounter [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Registered counter for database nova_cell0 Jul 15 17:46:21.065203 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_db.sqlalchemy.engines [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:46:21.069849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writer thread running {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:46:21.298762 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: WARNING keystonemiddleware.auth_token [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:46:21.306304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: WARNING keystonemiddleware.auth_token [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:46:21.392558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: WARNING keystonemiddleware.auth_token [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:46:21.399885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: WARNING keystonemiddleware.auth_token [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:46:21.651470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: WARNING keystonemiddleware.auth_token [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:46:21.658007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: WARNING keystonemiddleware.auth_token [None req-444c07fd-d1c8-4c63-b914-50b8e16365c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:46:21.663496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560c224649c0 pid: 124745 (default app) Jul 15 17:46:21.746826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: WARNING keystonemiddleware.auth_token [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 15 17:46:21.752813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: WARNING keystonemiddleware.auth_token [None req-6b42f272-e549-47a0-82e2-0c43d42fe630 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 15 17:46:21.758356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560c224649c0 pid: 124743 (default app) Jul 15 17:47:01.948243 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:01.949103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:01.949961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:01.950539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:02.858741 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:02.860674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:02.861597 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:02.862487 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:03.142796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-765e702d-ffc6-4164-b958-82a8d1f18750 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Action: 'create', calling method: .version_select at 0x7f37d34fa8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1436831678", "metadata": {"Type": "work"}}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:04.188776 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-59e075c3-b55e-4748-a83c-8ea178e616b1 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Action: 'create', calling method: .version_select at 0x7f37d34fa820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-454652649"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:05.353392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-765e702d-ffc6-4164-b958-82a8d1f18750 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.415671 Jul 15 17:47:05.354893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 15 17:47:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 17:47:05.369188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ce3eb597-8369-4cc7-b047-86a25fa0aff3 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33c5700>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:05.438790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ce3eb597-8369-4cc7-b047-86a25fa0aff3 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 200 len: 353 microversion: 2.1 time: 0.074390 Jul 15 17:47:05.439737 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 2/2] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:05 2022] GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:05.581431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-59e075c3-b55e-4748-a83c-8ea178e616b1 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.736100 Jul 15 17:47:05.582409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1154 bytes} [Fri Jul 15 17:47:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2739 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 15 17:47:05.594495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c573cc69-8b61-47b0-a02b-f6857fd08329 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33c5a60>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:05.688956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c573cc69-8b61-47b0-a02b-f6857fd08329 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 200 len: 344 microversion: 2.1 time: 0.097615 Jul 15 17:47:05.693836 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:05 2022] GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:06.453610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4738486b-ace9-478e-97b1-bfca7391c72f tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33c3700>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:06.561110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4738486b-ace9-478e-97b1-bfca7391c72f tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 200 len: 353 microversion: 2.1 time: 0.111460 Jul 15 17:47:06.575573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 2/5] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:06 2022] GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:06.701266 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a7833a48-8cc2-4fc5-99c2-1ffdfd15ded6 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33c5ee0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:06.777233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a7833a48-8cc2-4fc5-99c2-1ffdfd15ded6 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 200 len: 344 microversion: 2.1 time: 0.080008 Jul 15 17:47:06.778251 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:06 2022] GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:07.585424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-eae789ec-1b55-49d2-8520-757ee423411e tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33c3a60>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:07.668091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-eae789ec-1b55-49d2-8520-757ee423411e tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 200 len: 354 microversion: 2.1 time: 0.089035 Jul 15 17:47:07.681022 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:07 2022] GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:07.682831 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c7c9410b-973a-474f-b407-b1caf3971623 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33dc5e0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:07.792963 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c7c9410b-973a-474f-b407-b1caf3971623 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 200 len: 354 microversion: 2.1 time: 0.115635 Jul 15 17:47:07.793648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:07 2022] GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:07.802255 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-da550f75-c084-4b21-a9d5-604e90899d2a tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33c3ee0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:07.815577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-85c486d8-a46a-4b13-8175-a549114b372a tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33c54c0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:07.940082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-da550f75-c084-4b21-a9d5-604e90899d2a tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 200 len: 345 microversion: 2.1 time: 0.153559 Jul 15 17:47:07.941235 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 4/9] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:07 2022] GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:07.955538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-90357c16-7dd9-4d1b-a7b6-7ac596da1872 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Action: 'create', calling method: .version_select at 0x7f37d33db550>, body: {"snapshot": {"volume_id": "b4aead7d-eade-4717-8d97-66bf2f8f6764", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-377240870"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:08.201369 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-85c486d8-a46a-4b13-8175-a549114b372a tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 202 len: 0 microversion: 2.1 time: 0.399105 Jul 15 17:47:08.202221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 6/10] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:47:07 2022] DELETE /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:47:08.211134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f72828e5-7f96-421b-8901-cd0fdcfbc762 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33c5b80>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:08.306256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f72828e5-7f96-421b-8901-cd0fdcfbc762 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 200 len: 353 microversion: 2.1 time: 0.098560 Jul 15 17:47:08.313795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 7/11] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:08 2022] GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:08.878851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-90357c16-7dd9-4d1b-a7b6-7ac596da1872 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.929129 Jul 15 17:47:08.880121 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 5/12] 10.222.0.57 () {60 vars in 1161 bytes} [Fri Jul 15 17:47:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:08.891442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2ea4377a-c0ac-4459-b5ae-2b44a5487297 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33dc550>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:09.030623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2ea4377a-c0ac-4459-b5ae-2b44a5487297 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 286 microversion: 2.1 time: 0.143128 Jul 15 17:47:09.031471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:08 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:09.041460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bd7a5d51-a6f3-489c-bdc2-dc52c2e50918 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33c3dc0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:09.121574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-bd7a5d51-a6f3-489c-bdc2-dc52c2e50918 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.083951 Jul 15 17:47:09.122127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 6/14] 10.222.0.57 () {58 vars in 1139 bytes} [Fri Jul 15 17:47:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:09.135575 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7326bd80-061f-46da-bb61-56588596b594 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33c5940>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:09.182835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7326bd80-061f-46da-bb61-56588596b594 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 286 microversion: 2.1 time: 0.052239 Jul 15 17:47:09.183572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 9/15] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:09 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:09.320166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-28ae63fe-6fc3-4071-b36c-515f21e094b4 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Calling method '.version_select at 0x7f37d33dba60>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:09.379608 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-28ae63fe-6fc3-4071-b36c-515f21e094b4 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] HTTP exception thrown: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-28ae63fe-6fc3-4071-b36c-515f21e094b4 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Request method failure captured: Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 HTTP/1.1 Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agVWS0lekLhF4Dz1ufnNimUoMJ1sYs_n2DIdzj-XQhzGJLuV177Lfiq8gYXhIXMT7gdowUmtUp7SgvyYnyFWNGINpIPfl3mGZP4iaydHAO_QGVKg0b9-LJ_UsqOU7tGdnHUNvnWQqONgt-Cf2939jf8uuwr6_PQEIE1abWpznb_54A Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: e07727b74ad4488bb3c60bcc5406b328 Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-VolumesGetTestJSON-1413562397 Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:47:09.384027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e07727b74ad4488bb3c60bcc5406b328"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e07727b74ad4488bb3c60bcc5406b328"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e07727b74ad4488bb3c60bcc5406b328", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e07727b74ad4488bb3c60bcc5406b328"}]}] Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-VolumesGetTestJSON-1413562397 Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: e07727b74ad4488bb3c60bcc5406b328 Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-VolumesGetTestJSON-1413562397 Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-VolumesGetTestJSON-1413562397-project Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: a8a70c43fb514e1cbecf5b4577c0c7ac Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-VolumesGetTestJSON-1413562397-project Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'e35b6781-a201-46ad-b8f1-05fcd32c79a2'} Jul 15 17:47:09.385376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. (HTTP 404) (Request-ID: req-99e27278-9cb2-4bbc-a879-979e2c40b9bc) Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:09.386119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:09.387177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 17:47:09.388225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. Jul 15 17:47:09.389328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:09.390649 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-28ae63fe-6fc3-4071-b36c-515f21e094b4 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] Returning 404 to user: Volume e35b6781-a201-46ad-b8f1-05fcd32c79a2 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:09.391498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-28ae63fe-6fc3-4071-b36c-515f21e094b4 tempest-VolumesGetTestJSON-1413562397 tempest-VolumesGetTestJSON-1413562397-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2" status: 404 len: 109 microversion: 2.1 time: 0.075908 Jul 15 17:47:09.392211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 7/16] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:09 2022] GET /compute/v2.1/os-volumes/e35b6781-a201-46ad-b8f1-05fcd32c79a2 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:10.201795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-18a520a1-40e6-4b61-9309-904300b10a99 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33c5f70>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:10.389980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-18a520a1-40e6-4b61-9309-904300b10a99 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 286 microversion: 2.1 time: 0.197796 Jul 15 17:47:10.390787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 10/17] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:10 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 286 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:11.403434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b386bbb3-5d51-4f52-ab02-93f8cd320f18 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d3348040>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:11.491295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b386bbb3-5d51-4f52-ab02-93f8cd320f18 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 286 microversion: 2.1 time: 0.086887 Jul 15 17:47:11.491295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 8/18] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:11 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:12.498014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5b8fdc9f-4670-4b0e-8526-9bb9e2565e2f tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33dc670>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:12.559778 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5b8fdc9f-4670-4b0e-8526-9bb9e2565e2f tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 286 microversion: 2.1 time: 0.065933 Jul 15 17:47:12.560723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 11/19] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:12 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:13.571664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9161fa80-a265-440a-9ca6-71bd57a1ad0f tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d3348790>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:13.633340 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9161fa80-a265-440a-9ca6-71bd57a1ad0f tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 287 microversion: 2.1 time: 0.065230 Jul 15 17:47:13.633773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 9/20] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:13 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:13.644623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6794a453-9874-4473-acfd-a0baa7834286 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33dce50>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:13.818356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6794a453-9874-4473-acfd-a0baa7834286 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 202 len: 0 microversion: 2.1 time: 0.177808 Jul 15 17:47:13.818913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 12/21] 10.222.0.57 () {58 vars in 1253 bytes} [Fri Jul 15 17:47:13 2022] DELETE /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:47:13.827966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-90ebbf86-c729-4bcd-9434-8a46a7a25fa2 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33dbee0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:13.952649 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-90ebbf86-c729-4bcd-9434-8a46a7a25fa2 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 200 len: 286 microversion: 2.1 time: 0.127975 Jul 15 17:47:13.956244 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 10/22] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:13 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:14.964922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-733df79f-837b-4109-883b-ab8c986dc0ce tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d3348670>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:15.010918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-733df79f-837b-4109-883b-ab8c986dc0ce tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] HTTP exception thrown: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-733df79f-837b-4109-883b-ab8c986dc0ce tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Request method failure captured: Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 HTTP/1.1 Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agWz0OKZZ2btR2EHzJalf1YKPYqUW9-SLSQH-wit5DXtG_S1DYtySChe5RJLr_WBcN_c_9NzElNn0WzhcWPabWM_ro9852H5z4t4mcczaKWr5W91UZogqp5TN0cqswFUnUgstJBGWvTFMbMo7vKPDjWif9fH00qQFvfTnQQTDl48jI Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:47:15.013913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae3edb73a0024048b8ad94624376f8a7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}] Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 9c00f4aefb2b4d48a19214460e2260c9 Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '91127f3b-3316-4a2d-af3c-f0891eeafe37'} Jul 15 17:47:15.023374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. (HTTP 404) (Request-ID: req-95923023-f229-4eec-af69-10fce4a09681) Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.024036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:15.025135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 15 17:47:15.026427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-733df79f-837b-4109-883b-ab8c986dc0ce tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Returning 404 to user: Snapshot 91127f3b-3316-4a2d-af3c-f0891eeafe37 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-733df79f-837b-4109-883b-ab8c986dc0ce tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37" status: 404 len: 111 microversion: 2.1 time: 0.055013 Jul 15 17:47:15.028265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 15 17:47:14 2022] GET /compute/v2.1/os-snapshots/91127f3b-3316-4a2d-af3c-f0891eeafe37 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:47:15.032318 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6baa0b1b-c114-4e50-9de1-130e5ed7d385 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d3348310>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:15.193093 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-90a30cfb-5195-4450-aeea-bb88c1114336 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Action: 'create', calling method: .version_select at 0x7f37d33dcaf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-996022575", "metadata": {"Type": "work"}}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-90a30cfb-5195-4450-aeea-bb88c1114336 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Request method failure captured: Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 121 Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agib7RIWZVPJwksZ-DOLqk2bM8zOszsmS9fnnoZ2W6jUTM3vi2LHqEcRTBO0BC1Xbs158ZR04M7LABAXS_9XoRqsOFZaG25l1E0qxQx3CucD-DIkXUtWqsv8kRLPc_GUpsGNfAw5OOoF7IING3U4YfnNP7aKOBkTitD9n566ZJ30lc Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:15.217639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5871a7531d64d3297241a0461e0d631", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}] Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: df563d10d16340fb9c4e32478fd5df8b Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-996022575", "metadata": {"Type": "work"}}} Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:15.223060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-996022575', 'metadata': {'Type': 'work'}}}} Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise error Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi '#$%' Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.226545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 17:47:15.229349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 17:47:15.232682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 15 17:47:15.232682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.232682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-90a30cfb-5195-4450-aeea-bb88c1114336 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.232682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-90a30cfb-5195-4450-aeea-bb88c1114336 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.336284 Jul 15 17:47:15.232682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 13/24] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 15 17:47:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 337 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:47:15.232682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-09f006e5-1d66-486c-8b32-c336b023f1b5 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Action: 'create', calling method: .version_select at 0x7f37d33c5940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1292779365", "metadata": {"Type": "work"}}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-09f006e5-1d66-486c-8b32-c336b023f1b5 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Request method failure captured: Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 120 Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agib7RIWZVPJwksZ-DOLqk2bM8zOszsmS9fnnoZ2W6jUTM3vi2LHqEcRTBO0BC1Xbs158ZR04M7LABAXS_9XoRqsOFZaG25l1E0qxQx3CucD-DIkXUtWqsv8kRLPc_GUpsGNfAw5OOoF7IING3U4YfnNP7aKOBkTitD9n566ZJ30lc Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:15.260854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5871a7531d64d3297241a0461e0d631", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}] Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: df563d10d16340fb9c4e32478fd5df8b Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1292779365", "metadata": {"Type": "work"}}} Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:15.261940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1292779365', 'metadata': {'Type': 'work'}}}} Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise error Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi '0' Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.262561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 17:47:15.263545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 17:47:15.264651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 15 17:47:15.264651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.264651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-09f006e5-1d66-486c-8b32-c336b023f1b5 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.264651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-09f006e5-1d66-486c-8b32-c336b023f1b5 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.036767 Jul 15 17:47:15.264651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 14/25] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 15 17:47:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 15 17:47:15.286689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ddc6f63b-d921-4509-961d-360cfc5ad48b tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Action: 'create', calling method: .version_select at 0x7f37d3dab9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-416221968", "metadata": {"Type": "work"}}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ddc6f63b-d921-4509-961d-360cfc5ad48b tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Request method failure captured: Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 118 Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agib7RIWZVPJwksZ-DOLqk2bM8zOszsmS9fnnoZ2W6jUTM3vi2LHqEcRTBO0BC1Xbs158ZR04M7LABAXS_9XoRqsOFZaG25l1E0qxQx3CucD-DIkXUtWqsv8kRLPc_GUpsGNfAw5OOoF7IING3U4YfnNP7aKOBkTitD9n566ZJ30lc Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:15.295328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5871a7531d64d3297241a0461e0d631", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}] Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: df563d10d16340fb9c4e32478fd5df8b Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-416221968", "metadata": {"Type": "work"}}} Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:15.296468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-416221968', 'metadata': {'Type': 'work'}}}} Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise error Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi '' Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.297118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 15 17:47:15.298141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 15 17:47:15.299046 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 15 17:47:15.299046 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.302425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ddc6f63b-d921-4509-961d-360cfc5ad48b tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.305139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ddc6f63b-d921-4509-961d-360cfc5ad48b tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034717 Jul 15 17:47:15.307951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 15/26] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 15 17:47:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:47:15.319468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7184e2af-f908-45b2-9667-f3672addfd9e tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Calling method '.version_select at 0x7f37d33a2790>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:15.532045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-7184e2af-f908-45b2-9667-f3672addfd9e tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] HTTP exception thrown: Volume tempest-invalid-742031981 could not be found. Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7184e2af-f908-45b2-9667-f3672addfd9e tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Request method failure captured: Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-742031981 HTTP/1.1 Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agib7RIWZVPJwksZ-DOLqk2bM8zOszsmS9fnnoZ2W6jUTM3vi2LHqEcRTBO0BC1Xbs158ZR04M7LABAXS_9XoRqsOFZaG25l1E0qxQx3CucD-DIkXUtWqsv8kRLPc_GUpsGNfAw5OOoF7IING3U4YfnNP7aKOBkTitD9n566ZJ30lc Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:15.536639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5871a7531d64d3297241a0461e0d631", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}] Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: df563d10d16340fb9c4e32478fd5df8b Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Volume tempest-invalid-742031981 could not be found. Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'tempest-invalid-742031981'} Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.537808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-742031981 could not be found. (HTTP 404) (Request-ID: req-f2d2ca35-d641-4d63-bc70-a51992b4bee0) Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.538654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 17:47:15.540204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-742031981 could not be found. Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:15.550032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-742031981 could not be found. Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-742031981 could not be found. Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7184e2af-f908-45b2-9667-f3672addfd9e tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Returning 404 to user: Volume tempest-invalid-742031981 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7184e2af-f908-45b2-9667-f3672addfd9e tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-742031981" status: 404 len: 98 microversion: 2.1 time: 0.228863 Jul 15 17:47:15.550994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 16/27] 10.222.0.57 () {58 vars in 1214 bytes} [Fri Jul 15 17:47:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-742031981 => generated 98 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 15 17:47:15.553654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8f86e534-3ab1-48d2-87b0-cd08d366ecf4 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007302 Jul 15 17:47:15.565615 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 17/28] 10.222.0.57 () {58 vars in 1139 bytes} [Fri Jul 15 17:47:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 17:47:15.574096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-530d189f-0969-41e2-b971-6a8783b2b400 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003806 Jul 15 17:47:15.585101 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6baa0b1b-c114-4e50-9de1-130e5ed7d385 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 202 len: 0 microversion: 2.1 time: 0.563271 Jul 15 17:47:15.590153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 12/29] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:47:15 2022] DELETE /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:47:15.592108 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 18/30] 10.222.0.57 () {58 vars in 1136 bytes} [Fri Jul 15 17:47:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 15 17:47:15.597567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-26f013d6-1c36-4d56-aaad-2ad78484cee9 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33db3a0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:15.607733 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-945493c3-a949-4d86-b056-2c1943417eed tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Calling method '.version_select at 0x7f37d33a2430>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:15.670874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-945493c3-a949-4d86-b056-2c1943417eed tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] HTTP exception thrown: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-945493c3-a949-4d86-b056-2c1943417eed tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Request method failure captured: Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: DELETE /compute/v2.1/os-volumes/cb3fcc4d-653b-449e-964a-8fb6d2f31f7b HTTP/1.1 Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agib7RIWZVPJwksZ-DOLqk2bM8zOszsmS9fnnoZ2W6jUTM3vi2LHqEcRTBO0BC1Xbs158ZR04M7LABAXS_9XoRqsOFZaG25l1E0qxQx3CucD-DIkXUtWqsv8kRLPc_GUpsGNfAw5OOoF7IING3U4YfnNP7aKOBkTitD9n566ZJ30lc Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:15.673385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5871a7531d64d3297241a0461e0d631", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}] Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: df563d10d16340fb9c4e32478fd5df8b Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'cb3fcc4d-653b-449e-964a-8fb6d2f31f7b'} Jul 15 17:47:15.674705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. (HTTP 404) (Request-ID: req-59ea9cce-2ea4-49fc-afb6-1cbe652999fd) Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.675481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 17:47:15.682092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 17:47:15.683255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-945493c3-a949-4d86-b056-2c1943417eed tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Returning 404 to user: Volume cb3fcc4d-653b-449e-964a-8fb6d2f31f7b could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-945493c3-a949-4d86-b056-2c1943417eed tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/cb3fcc4d-653b-449e-964a-8fb6d2f31f7b" status: 404 len: 109 microversion: 2.1 time: 0.076376 Jul 15 17:47:15.684334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 19/31] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:47:15 2022] DELETE /compute/v2.1/os-volumes/cb3fcc4d-653b-449e-964a-8fb6d2f31f7b => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:15.686874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9780684-4407-485c-8893-dee6d3d02300 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Calling method '.version_select at 0x7f37d33c5ca0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:15.701969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-26f013d6-1c36-4d56-aaad-2ad78484cee9 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 200 len: 344 microversion: 2.1 time: 0.110474 Jul 15 17:47:15.702756 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 13/32] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:15 2022] GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:15.755161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-f9780684-4407-485c-8893-dee6d3d02300 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] HTTP exception thrown: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9780684-4407-485c-8893-dee6d3d02300 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Request method failure captured: Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/os-volumes/f9ccaec9-b544-4e79-b2e1-34bc18f4b78a HTTP/1.1 Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agib7RIWZVPJwksZ-DOLqk2bM8zOszsmS9fnnoZ2W6jUTM3vi2LHqEcRTBO0BC1Xbs158ZR04M7LABAXS_9XoRqsOFZaG25l1E0qxQx3CucD-DIkXUtWqsv8kRLPc_GUpsGNfAw5OOoF7IING3U4YfnNP7aKOBkTitD9n566ZJ30lc Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:15.758562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5871a7531d64d3297241a0461e0d631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5871a7531d64d3297241a0461e0d631", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5871a7531d64d3297241a0461e0d631"}]}] Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: c5871a7531d64d3297241a0461e0d631 Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-44833590 Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: df563d10d16340fb9c4e32478fd5df8b Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-44833590-project Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'f9ccaec9-b544-4e79-b2e1-34bc18f4b78a'} Jul 15 17:47:15.759532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. (HTTP 404) (Request-ID: req-b4b19a12-ce72-4243-926a-102409b7b5af) Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.760734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:15.761620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 17:47:15.762480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:15.763345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9780684-4407-485c-8893-dee6d3d02300 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] Returning 404 to user: Volume f9ccaec9-b544-4e79-b2e1-34bc18f4b78a could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:15.770673 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f9780684-4407-485c-8893-dee6d3d02300 tempest-VolumesNegativeTest-44833590 tempest-VolumesNegativeTest-44833590-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/f9ccaec9-b544-4e79-b2e1-34bc18f4b78a" status: 404 len: 109 microversion: 2.1 time: 0.079031 Jul 15 17:47:15.771392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 20/33] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:15 2022] GET /compute/v2.1/os-volumes/f9ccaec9-b544-4e79-b2e1-34bc18f4b78a => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:47:16.715110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-16fcc260-1338-40d4-a100-7f81e12dd0fa tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d3360040>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:16.763572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-16fcc260-1338-40d4-a100-7f81e12dd0fa tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] HTTP exception thrown: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-16fcc260-1338-40d4-a100-7f81e12dd0fa tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Request method failure captured: Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 HTTP/1.1 Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agWz0OKZZ2btR2EHzJalf1YKPYqUW9-SLSQH-wit5DXtG_S1DYtySChe5RJLr_WBcN_c_9NzElNn0WzhcWPabWM_ro9852H5z4t4mcczaKWr5W91UZogqp5TN0cqswFUnUgstJBGWvTFMbMo7vKPDjWif9fH00qQFvfTnQQTDl48jI Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:47:16.766967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae3edb73a0024048b8ad94624376f8a7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}] Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 9c00f4aefb2b4d48a19214460e2260c9 Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'b4aead7d-eade-4717-8d97-66bf2f8f6764'} Jul 15 17:47:16.768229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. (HTTP 404) (Request-ID: req-ee131378-6700-4f33-a1ce-e0a1e940fbb3) Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.768907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:16.770577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 17:47:16.782350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-16fcc260-1338-40d4-a100-7f81e12dd0fa tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Returning 404 to user: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-16fcc260-1338-40d4-a100-7f81e12dd0fa tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 404 len: 109 microversion: 2.1 time: 0.057785 Jul 15 17:47:16.783956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 14/34] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:16 2022] GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:47:16.787993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-494402be-82d4-4039-9fec-1e4e66ba9ecb tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d33a25e0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:16.826851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-494402be-82d4-4039-9fec-1e4e66ba9ecb tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] HTTP exception thrown: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-494402be-82d4-4039-9fec-1e4e66ba9ecb tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Request method failure captured: Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: DELETE /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 HTTP/1.1 Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agWz0OKZZ2btR2EHzJalf1YKPYqUW9-SLSQH-wit5DXtG_S1DYtySChe5RJLr_WBcN_c_9NzElNn0WzhcWPabWM_ro9852H5z4t4mcczaKWr5W91UZogqp5TN0cqswFUnUgstJBGWvTFMbMo7vKPDjWif9fH00qQFvfTnQQTDl48jI Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:47:16.831182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae3edb73a0024048b8ad94624376f8a7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}] Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 9c00f4aefb2b4d48a19214460e2260c9 Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'b4aead7d-eade-4717-8d97-66bf2f8f6764'} Jul 15 17:47:16.832232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. (HTTP 404) (Request-ID: req-3fb8edae-4a43-4452-a148-d1de199fa157) Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.832862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 15 17:47:16.836537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 15 17:47:16.838368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-494402be-82d4-4039-9fec-1e4e66ba9ecb tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Returning 404 to user: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-494402be-82d4-4039-9fec-1e4e66ba9ecb tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 404 len: 109 microversion: 2.1 time: 0.053071 Jul 15 17:47:16.839548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 21/35] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:47:16 2022] DELETE /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:16.847968 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-79c9e551-1761-4fee-9305-7d8088843478 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Calling method '.version_select at 0x7f37d3348a60>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:16.917295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-79c9e551-1761-4fee-9305-7d8088843478 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] HTTP exception thrown: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-79c9e551-1761-4fee-9305-7d8088843478 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Request method failure captured: Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 HTTP/1.1 Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agWz0OKZZ2btR2EHzJalf1YKPYqUW9-SLSQH-wit5DXtG_S1DYtySChe5RJLr_WBcN_c_9NzElNn0WzhcWPabWM_ro9852H5z4t4mcczaKWr5W91UZogqp5TN0cqswFUnUgstJBGWvTFMbMo7vKPDjWif9fH00qQFvfTnQQTDl48jI Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:47:16.919573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae3edb73a0024048b8ad94624376f8a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae3edb73a0024048b8ad94624376f8a7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae3edb73a0024048b8ad94624376f8a7"}]}] Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: ae3edb73a0024048b8ad94624376f8a7 Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-804685353 Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 9c00f4aefb2b4d48a19214460e2260c9 Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-804685353-project Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'b4aead7d-eade-4717-8d97-66bf2f8f6764'} Jul 15 17:47:16.920664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. (HTTP 404) (Request-ID: req-2b140cfd-e540-4c55-b57c-b2bc98fa1e8f) Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.931082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 15 17:47:16.932793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 15 17:47:16.933665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-79c9e551-1761-4fee-9305-7d8088843478 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] Returning 404 to user: Volume b4aead7d-eade-4717-8d97-66bf2f8f6764 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:47:16.934548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-79c9e551-1761-4fee-9305-7d8088843478 tempest-VolumesSnapshotsTestJSON-804685353 tempest-VolumesSnapshotsTestJSON-804685353-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764" status: 404 len: 109 microversion: 2.1 time: 0.081285 Jul 15 17:47:16.937495 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 15/36] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:47:16 2022] GET /compute/v2.1/os-volumes/b4aead7d-eade-4717-8d97-66bf2f8f6764 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:18.183583 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-547abd04-9679-429b-b14d-2a3b306838dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: .version_select at 0x7f37d33c5550>, body: {"keypair": {"name": "tempest-keypair-584927620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUZhJsA+eDapBRYL01oDadUvoQFY6e1vUE+lVDfEYv9UUFtK3XGSDVdE/YUrag4/E1S+VQToLXgVwGHB7x12U7SXzePh76jBEgqbK9l54205A4Z4zOtoEmXOc+a7QVt1g=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:18.283609 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-547abd04-9679-429b-b14d-2a3b306838dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:18.297511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-547abd04-9679-429b-b14d-2a3b306838dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:18.485787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-547abd04-9679-429b-b14d-2a3b306838dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.527889 Jul 15 17:47:18.485787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 22/37] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:47:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:18.495581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-30b858b3-f5e3-4a00-ab90-fabb7810ffe2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: .version_select at 0x7f37d33483a0>, body: {"keypair": {"name": "tempest-keypair-1339602627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOBkva0ExAcGvg92CXDfPaa/nbTC3X3EuV5FF4cE68K5JUZB+5Vroi5oRHaHAKKCLhga1ZoWtFgfpqkh6laK+K0cFge/JJ8efRKrwkzO7+K6B9TVnsiTaO2c57WXlQs4Q=="}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:18.600268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-30b858b3-f5e3-4a00-ab90-fabb7810ffe2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for project fbcdf72827044c04842b74194eaf13c3. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:18.614142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-30b858b3-f5e3-4a00-ab90-fabb7810ffe2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for user 5013f4ba5cef44f7bdab6531ec0b0836 and project fbcdf72827044c04842b74194eaf13c3. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:18.788041 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-30b858b3-f5e3-4a00-ab90-fabb7810ffe2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.388662 Jul 15 17:47:18.788976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 16/38] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:47:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:24.801851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1887710799", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "networks": [{"uuid": "773f9db2-ed57-41b3-9c1c-dcbc2e73bc2a"}]}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:25.033580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] validate_networks() for [('773f9db2-ed57-41b3-9c1c-dcbc2e73bc2a', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:47:28.122445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-31910269", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:28.313331 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=4 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:28.366939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] validate_networks() for [('5b5e5652-3efb-4c6e-8f01-1ea55e108f86', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:47:28.628879 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=4 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:28.968283 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:47:28.969316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:47:28.970324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:47:28.970940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:47:28.971569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:47:28.988823 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:28.991637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:28.992776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:28.996270 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:29.035614 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Getting quotas for project 70f83741fb5241efad1b22e93cc67450. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:29.040864 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Getting quotas for user 1c230254925a43ac9fe52dffbd0fe3ed and project 70f83741fb5241efad1b22e93cc67450. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:29.068564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:47:29.073745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:47:29.334771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-429b97d3-273f-4ccd-937d-18b3178c5a5a tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.692478 Jul 15 17:47:29.335367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 23/39] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:47:30.058111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4fc218a4-6f06-4cc3-9d87-ad5ea9543893 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'create', calling method: .version_select at 0x7f37d2a6cc10>, body: {"keypair": {"name": "tempest-keypair-726897453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy0cmDpxHtF5Cz3qorgmmWZV7XovMT7DhtW5l+0pQTn9HXuft0FrNz7iNz4BcHHGfpWe8HO+c8MAWHtd0syv07lxYRum4LDQfHUgzQhsQmHpO9H2fLJGuuAlPC7V6tsRQ=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:30.101423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-4fc218a4-6f06-4cc3-9d87-ad5ea9543893 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:30.107707 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-4fc218a4-6f06-4cc3-9d87-ad5ea9543893 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for user caab1412244c43adac226cb253a10880 and project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:30.234365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4fc218a4-6f06-4cc3-9d87-ad5ea9543893 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.896131 Jul 15 17:47:30.234365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 24/40] 10.222.0.57 () {62 vars in 1199 bytes} [Fri Jul 15 17:47:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 898 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 15 17:47:30.239950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1835688907", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9128f0d2-178e-413a-a0d2-d7efa1403a9e"}], "security_groups": [{"name": "tempest-securitygroup--1960308355"}], "key_name": "tempest-keypair-584927620", "user_data": "}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:30.513727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] validate_networks() for [('9128f0d2-178e-413a-a0d2-d7efa1403a9e', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:47:31.116569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:47:31.117352 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:47:31.117837 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:47:31.118492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:47:31.119661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:47:31.147312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:31.147831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:31.148668 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:31.149120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:31.258668 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for project 882c7039b37f45f8843752b457525d9b. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:31.283515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for user 8873b1c9f58a4adea93ebe21f5f3263d and project 882c7039b37f45f8843752b457525d9b. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:31.318089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:47:31.327085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:47:31.339143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:47:31.339143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:47:31.339143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:47:31.339143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:47:31.339143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:47:31.350214 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:31.350880 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:31.351906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:31.353602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:31.375115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:31.381511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:31.398138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:47:31.400969 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:47:31.583576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d873973c-4827-4da9-bed8-3f895f43af1d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.315929 Jul 15 17:47:31.586134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 17/41] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:47:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 4321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 17:47:31.614176 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-325533470", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d062dcd-93a8-4bc5-83ff-77d6296f6f1c"}], "security_groups": [{"name": "tempest-securitygroup--459909550"}], "key_name": "tempest-keypair-1339602627", "user_data": "}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:31.643493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7e4481e4-e710-49d7-abef-196f8e726a6d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.408161 Jul 15 17:47:31.646546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 25/42] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:47:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:47:31.659787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2c929ef5-8b87-4c41-ac3d-c59e86c50ccf tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:31.695138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2c929ef5-8b87-4c41-ac3d-c59e86c50ccf tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:31.887142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2c929ef5-8b87-4c41-ac3d-c59e86c50ccf tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:31.932730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2c929ef5-8b87-4c41-ac3d-c59e86c50ccf tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1215 microversion: 2.1 time: 0.283848 Jul 15 17:47:31.937430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 26/43] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:31 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:31.944282 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8a74d4a2-5294-485e-812a-58319ed24776 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:31.950802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8a74d4a2-5294-485e-812a-58319ed24776 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:32.030908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] validate_networks() for [('5d062dcd-93a8-4bc5-83ff-77d6296f6f1c', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:47:32.126783 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8a74d4a2-5294-485e-812a-58319ed24776 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:32.154029 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8a74d4a2-5294-485e-812a-58319ed24776 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1220 microversion: 2.1 time: 0.215783 Jul 15 17:47:32.157404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 27/44] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:31 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:32.165049 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-07b56e9c-9b84-4d6b-a4c5-374c36f9708f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:32.165926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-07b56e9c-9b84-4d6b-a4c5-374c36f9708f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:32.301250 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-07b56e9c-9b84-4d6b-a4c5-374c36f9708f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:32.318904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-07b56e9c-9b84-4d6b-a4c5-374c36f9708f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1241 microversion: 2.1 time: 0.158122 Jul 15 17:47:32.328633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 28/45] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:32 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:32.418224 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-735363711", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:32.532731 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] validate_networks() for [('5b5e5652-3efb-4c6e-8f01-1ea55e108f86', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:47:33.175399 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:47:33.175970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:47:33.176406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:47:33.176919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:47:33.177409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:47:33.205327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:33.205851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:33.225511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:33.225511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:33.287641 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for project fbcdf72827044c04842b74194eaf13c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:33.300224 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for user 5013f4ba5cef44f7bdab6531ec0b0836 and project fbcdf72827044c04842b74194eaf13c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:33.348569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:47:33.355172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:47:33.623485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c52cb3ca-e557-4b08-bd07-148c53beb0c1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.035042 Jul 15 17:47:33.631697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 18/46] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:47:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:47:33.638374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:33.639278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:33.655782 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:33.656490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:33.657629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:33.658552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:33.918472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:33.959676 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d68421be-7d5c-4fb4-91a8-3ae181b1013b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1211 microversion: 2.1 time: 0.326345 Jul 15 17:47:33.974697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 19/47] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:33 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1211 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:33.976496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:47:33.977048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:47:33.977624 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:47:33.978886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:47:33.979420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:47:33.992945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:33.994758 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:34.010442 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:34.012462 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:34.013390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:34.013845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:34.038990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:34.041083 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:34.043935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:34.046429 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:34.127779 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for project 882c7039b37f45f8843752b457525d9b. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:34.146807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for user 8873b1c9f58a4adea93ebe21f5f3263d and project 882c7039b37f45f8843752b457525d9b. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:34.153409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:34.163546 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a0558961-a77e-4705-ac07-a006e839f586 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1245 microversion: 2.1 time: 0.195133 Jul 15 17:47:34.165045 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 20/48] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:33 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1245 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:34.190567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-da20380f-1aa7-4ce9-9375-f85f3a59be2b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:34.191268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-da20380f-1aa7-4ce9-9375-f85f3a59be2b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:34.208348 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:47:34.218943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:47:34.288930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-da20380f-1aa7-4ce9-9375-f85f3a59be2b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:34.322640 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-da20380f-1aa7-4ce9-9375-f85f3a59be2b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1237 microversion: 2.1 time: 0.152732 Jul 15 17:47:34.334367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 21/49] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:34 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1237 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:34.491825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a703b5a2-ca38-413a-8e4d-01725b33a1c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.081656 Jul 15 17:47:34.494941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 29/50] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:47:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 17:47:34.504051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-20817b2d-0f64-4f4d-9ff9-80d962348e77 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:34.504920 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-20817b2d-0f64-4f4d-9ff9-80d962348e77 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:34.628570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-20817b2d-0f64-4f4d-9ff9-80d962348e77 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:34.641992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-20817b2d-0f64-4f4d-9ff9-80d962348e77 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1221 microversion: 2.1 time: 0.141632 Jul 15 17:47:34.645909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 22/51] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:34 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:34.984093 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:34.989870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:34.994547 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:34.995188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:34.995973 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:34.996716 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:35.183656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:35.184490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:35.194232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:35.196341 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:35.198958 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:35.199970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:35.202218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:35.215801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5d6fc89d-1976-4632-95b3-27f79dcd5e54 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1275 microversion: 2.1 time: 0.236600 Jul 15 17:47:35.216396 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 30/52] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:34 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:35.308046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:35.315494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6a551718-cdfd-43e5-8575-26bceca82dd5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1293 microversion: 2.1 time: 0.136945 Jul 15 17:47:35.316057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 23/53] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:35 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:35.339450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9ab31768-3533-4499-a00b-b4e446fc8a9f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:35.340125 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9ab31768-3533-4499-a00b-b4e446fc8a9f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:35.408419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9ab31768-3533-4499-a00b-b4e446fc8a9f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:35.416558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9ab31768-3533-4499-a00b-b4e446fc8a9f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1237 microversion: 2.1 time: 0.080987 Jul 15 17:47:35.417668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 31/54] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:35 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:35.662247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-27223c7f-6569-45bf-9261-8c9b6f30b18e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:35.663039 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-27223c7f-6569-45bf-9261-8c9b6f30b18e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:35.795571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-27223c7f-6569-45bf-9261-8c9b6f30b18e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:35.811407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-27223c7f-6569-45bf-9261-8c9b6f30b18e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1221 microversion: 2.1 time: 0.153195 Jul 15 17:47:35.812206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 24/55] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:35 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:36.234968 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:36.237537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:36.242700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.243324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.250175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.254750 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.333791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:36.334480 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:36.344430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.345082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.346078 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.346527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.432903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:36.449798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4ee605e6-3bfd-40c0-95a8-5ec039840a59 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1273 microversion: 2.1 time: 0.219118 Jul 15 17:47:36.458643 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 32/56] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:36 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:36.480802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-876174755", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0cf1084-5343-4f44-a2ae-469185090723"}], "security_groups": [{"name": "tempest-securitygroup--984823325"}], "key_name": "tempest-keypair-726897453", "user_data": "}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:36.505769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:36.524514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-20a38e60-65c8-435c-80e5-5ff95a7b3cb8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1301 microversion: 2.1 time: 0.189289 Jul 15 17:47:36.525437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 25/57] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:36 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1301 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:36.534453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:36.536642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:36.545488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.546339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.547639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.548381 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.675057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:36.685424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f9ca0eb7-c20e-46c0-b1ec-8d2ced19a631 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1233 microversion: 2.1 time: 0.158096 Jul 15 17:47:36.686603 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 26/58] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:36 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1233 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:36.701362 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] validate_networks() for [('d0cf1084-5343-4f44-a2ae-469185090723', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:47:36.834347 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:36.835097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:36.862564 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.866454 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:36.873023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:36.873023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:37.060288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:37.070331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ee5c5195-03cf-4245-ac7a-059ce42bb70e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1217 microversion: 2.1 time: 0.245467 Jul 15 17:47:37.072539 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 27/59] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:36 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:37.478659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:37.481071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:37.507970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:37.508434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:37.509286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:37.514423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:38.522928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:38.537103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4ac3dde9-d83c-47b9-bc13-e4c938c0a070 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 1.065910 Jul 15 17:47:38.545357 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 28/60] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:37 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:38.550643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:38.573561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:38.598802 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:38.599317 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:38.600105 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:38.600548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:38.853384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:38.867385 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0ac3fd56-d515-4265-8b19-611591e2c36f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.320610 Jul 15 17:47:38.868311 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 29/61] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:38 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:38.874229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:38.875115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:38.898894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:38.898894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:38.898894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:38.898894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.147723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:47:39.147723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:47:39.147723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:47:39.147723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:47:39.147723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:47:39.147723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:39.148749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:39.151031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.152416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.153502 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.154812 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.167997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-878359f9-20ff-4217-97f8-f2a0b2fcade6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1295 microversion: 2.1 time: 0.298348 Jul 15 17:47:39.168586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 30/62] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:38 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1295 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:39.182544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:47:39.187130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for user caab1412244c43adac226cb253a10880 and project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:47:39.189762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:39.193792 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:39.200715 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:47:39.204117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:47:39.260961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.261466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.262306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.265983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.416682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-240262d0-930f-409b-a1a2-8d911a5ec3ca tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.950455 Jul 15 17:47:39.416682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 33/63] 10.222.0.57 () {62 vars in 1187 bytes} [Fri Jul 15 17:47:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 17:47:39.426661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b72b485d-fe0f-4a6d-bcea-132354364c0a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:39.427290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b72b485d-fe0f-4a6d-bcea-132354364c0a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:39.481695 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:39.491767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8c26a2f2-d63e-4ad5-962e-c683d9bd244b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1279 microversion: 2.1 time: 0.312352 Jul 15 17:47:39.509717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 31/64] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:39 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:39.567445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:39.568540 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:39.591449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.591919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.592810 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.593253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.672254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b72b485d-fe0f-4a6d-bcea-132354364c0a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:39.684054 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b72b485d-fe0f-4a6d-bcea-132354364c0a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:39.686295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b72b485d-fe0f-4a6d-bcea-132354364c0a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:39.687802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b72b485d-fe0f-4a6d-bcea-132354364c0a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1280 microversion: 2.20 time: 0.266419 Jul 15 17:47:39.689267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 34/65] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:39 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:47:39.890615 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:39.891234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:39.907015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.915893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.915893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:39.915893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:39.993364 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:40.005946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-15b36086-149b-410e-be2d-97e0ed4d05f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.445915 Jul 15 17:47:40.006794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 32/66] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:39 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:40.186325 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:40.187172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:40.198406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:40.198406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:40.198406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:40.199116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:40.377827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:40.403368 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-157697e4-0f9f-4b33-8eb5-2b4a68084141 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1295 microversion: 2.1 time: 0.221205 Jul 15 17:47:40.411183 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 33/67] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:40 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:40.521863 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:40.522625 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:40.562512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:40.566191 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:40.569868 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:40.571876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:40.975935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:41.008256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cc813010-4566-4a03-9e59-79203dfd6438 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1279 microversion: 2.1 time: 0.481672 Jul 15 17:47:41.008954 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 34/68] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:40 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1279 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:41.016378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b619102f-4d23-4f8e-b643-87d8c0decdc4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:41.017012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b619102f-4d23-4f8e-b643-87d8c0decdc4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:41.151567 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:41.160155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2990dab5-726c-4532-8b9c-cef325d8567d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 1.278961 Jul 15 17:47:41.173057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 35/69] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:39 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:41.192073 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:41.192284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b619102f-4d23-4f8e-b643-87d8c0decdc4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:41.192424 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:41.200650 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b619102f-4d23-4f8e-b643-87d8c0decdc4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:41.202545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b619102f-4d23-4f8e-b643-87d8c0decdc4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:41.204404 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b619102f-4d23-4f8e-b643-87d8c0decdc4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1280 microversion: 2.20 time: 0.193976 Jul 15 17:47:41.204566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:41.204763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:41.205930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 35/70] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:41 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:41.216223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:41.218135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:41.429291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:41.429845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:41.450844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:41.451186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:41.456544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:41.458733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:41.757774 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:41.774256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-51d98283-6850-4ad6-94c9-5f60911aee09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1295 microversion: 2.1 time: 0.349152 Jul 15 17:47:41.799644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 36/71] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:41 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1295 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:41.964613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-d1a5bf91-a76e-4554-9929-f3271e61df17 req-1576a509-4fcb-467c-9f28-dc3402d8df1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb0a814-b77c-4172-a63d-a7433a5fa972", "tag": "c0814395-782b-444b-b1d2-4b900ea9cb9c"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:41.981277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d1a5bf91-a76e-4554-9929-f3271e61df17 req-1576a509-4fcb-467c-9f28-dc3402d8df1d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:41.982085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d1a5bf91-a76e-4554-9929-f3271e61df17 req-1576a509-4fcb-467c-9f28-dc3402d8df1d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.006415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-d1a5bf91-a76e-4554-9929-f3271e61df17 req-1576a509-4fcb-467c-9f28-dc3402d8df1d service nova] Creating event network-changed:c0814395-782b-444b-b1d2-4b900ea9cb9c for instance aeb0a814-b77c-4172-a63d-a7433a5fa972 on hv-cinder-83697 Jul 15 17:47:42.006922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d1a5bf91-a76e-4554-9929-f3271e61df17 req-1576a509-4fcb-467c-9f28-dc3402d8df1d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 17:47:42.008018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.008648 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.010098 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.010885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.020145 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.compute.rpcapi [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 17:47:42.021478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 17:47:42.039206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f719b5d1-74f8-424d-bacd-80387146fbf9 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195321 Jul 15 17:47:42.039809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 37/72] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:42.045208 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:42.045901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:42.052458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.052866 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.053620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.054051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.132778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:42.143759 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-46dc32a5-b8d3-4e1f-ab0d-778d2ae59f1f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1279 microversion: 2.1 time: 0.102401 Jul 15 17:47:42.145995 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 38/73] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:42 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:42.184581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:42.185599 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:42.186041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:42.193238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.193787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.205232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.205232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.205644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-94f71242-7305-41da-800d-b491ce9162f9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 1.029668 Jul 15 17:47:42.215347 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:42.217739 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 36/74] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:41 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:42.236019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:42.242534 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:42.251775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.252457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.255817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.256780 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.368743 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:42.390399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:42.392783 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:42.394647 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-09baa38c-cf1c-436a-ad58-79b4e9c035ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1276 microversion: 2.20 time: 0.175224 Jul 15 17:47:42.407636 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 37/75] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:42 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:42.515915 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:42.528960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f09cab40-0baf-4a03-a3b2-3baac868240c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.349708 Jul 15 17:47:42.530262 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 39/76] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:42 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:42.796706 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:42.797523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:42.809725 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.809725 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:42.809725 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:42.810960 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.163515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:43.164141 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:43.174564 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.175029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.175815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.176258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.390620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.398512 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7e2cd58e-aca8-4ba9-a6fd-f214017be0c5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.608958 Jul 15 17:47:43.399094 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 38/77] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:42 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:43.412352 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:43.413218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:43.426679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.427211 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.428093 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.428624 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.469731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.478623 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3bdd6608-6e6e-4f0f-98c5-6b89e45cd694 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.318820 Jul 15 17:47:43.480024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 40/78] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:43 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:43.486608 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:43.487475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:43.492154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:43.503617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.503617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.503617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.503617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.572218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.580970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.583171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.584453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ca0db383-e239-42d7-84a4-ee8523f1e4f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1276 microversion: 2.20 time: 0.102885 Jul 15 17:47:43.585210 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 41/79] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:43 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:43.591824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.610482 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9af666e4-b088-4fa5-a5c3-377790b9a358 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.206728 Jul 15 17:47:43.611426 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 39/80] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:43 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:43.627484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:43.627484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:43.633658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.634688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.635461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.635894 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.664304 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-07c47b38-5c9d-4fae-a992-893d44e86e4d req-6ba93b08-ee97-442b-b0dd-a9b18065fa59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66074efc-9ad1-4fff-89f6-b16920004511", "tag": "61f90384-5142-4b61-b7be-b8f00310b1fa"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:43.674310 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-07c47b38-5c9d-4fae-a992-893d44e86e4d req-6ba93b08-ee97-442b-b0dd-a9b18065fa59 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:43.676481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-07c47b38-5c9d-4fae-a992-893d44e86e4d req-6ba93b08-ee97-442b-b0dd-a9b18065fa59 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:43.687917 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-07c47b38-5c9d-4fae-a992-893d44e86e4d req-6ba93b08-ee97-442b-b0dd-a9b18065fa59 service nova] Creating event network-changed:61f90384-5142-4b61-b7be-b8f00310b1fa for instance 66074efc-9ad1-4fff-89f6-b16920004511 on hv-cinder-83697 Jul 15 17:47:43.693679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-07c47b38-5c9d-4fae-a992-893d44e86e4d req-6ba93b08-ee97-442b-b0dd-a9b18065fa59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106921 Jul 15 17:47:43.695271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 42/81] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:43.798494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:43.808693 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-35805f0b-3791-4493-bb2d-444f4435c9c0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.195969 Jul 15 17:47:43.809298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 40/82] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:43 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:44.417075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:44.418508 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:44.426570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.427299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.428554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.429894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.499456 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:44.500788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:44.519923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.523875 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.525688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.526454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.720472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:44.731995 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-48c165a9-3263-418b-8d50-b93375cf3c88 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.319103 Jul 15 17:47:44.733256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 43/83] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:44 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:44.738178 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:44.739009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:44.746517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.748236 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.749104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.749963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.874679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:44.888053 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:44.890452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:44.902745 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4f478b9a-05fa-46cd-87be-6a3b6323a824 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1276 microversion: 2.20 time: 0.157064 Jul 15 17:47:44.902745 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 44/84] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:44 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:44.903045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:44.904230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-143b8b89-c2d0-4517-8766-b0e423ecc115 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.411659 Jul 15 17:47:44.906445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:44.907018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:44.910110 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 41/85] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:44 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:44.913303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.913758 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.914538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.915005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.940198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:44.942292 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:44.969396 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.969958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:44.972257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:44.972729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:45.518155 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:45.541054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c0569187-3571-4a9c-809a-a914ded12010 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.647179 Jul 15 17:47:45.553438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 45/86] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:44 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:45.749136 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:45.749756 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:45.757186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:45.757649 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:45.758439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:45.759475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:45.982111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:45.996575 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f8150a5f-b9c6-44be-ae90-8272f7b951b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 1.084962 Jul 15 17:47:46.007859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 42/87] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:44 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:46.010027 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:46.013333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:46.032408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:46.037213 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:46.038221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:46.038951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:46.085647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:46.094938 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0e95f8b3-d364-4696-a74d-563bb7c084e2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.349389 Jul 15 17:47:46.098661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 46/88] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:45 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:46.105044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:46.105979 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:46.122615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:46.127713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:46.128758 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:46.130694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:46.400287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:46.410152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2c72657c-810d-49cd-b320-9bdd8abd89c9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.310112 Jul 15 17:47:46.414517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 47/89] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:46 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:46.543388 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:46.561918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:46.563576 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:46.570976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:46.571735 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:46.572813 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d56dfba1-8c85-4eb7-a646-5c2cc29cad76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1332 microversion: 2.20 time: 0.564358 Jul 15 17:47:46.573477 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 43/90] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:45 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1332 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:46.579981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:46.591702 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:46.592559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:46.601257 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.014182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:47.015495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:47.022659 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.023350 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.024874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.025500 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.191838 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:47.200834 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2b2ac413-efb6-4ef9-b2c0-1b63e536b67d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.634547 Jul 15 17:47:47.204187 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 48/91] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:46 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:47.207232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:47.207907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:47.219752 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.220387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.222081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.227554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.802720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:47.808191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7c95a60f-8a18-4ab1-aec3-83d0c32eeeaf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.797581 Jul 15 17:47:47.822515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 44/92] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:47 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:47.828953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:47.829621 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:47.839710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.842445 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.843287 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.843736 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.866721 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:47.886419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-10b37eef-2919-4cf1-825b-154052f74acf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.683277 Jul 15 17:47:47.887005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 49/93] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:47 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:47.902109 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:47.903340 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:47.924278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.924773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:47.925556 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:47.925994 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:48.039595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:48.058456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:48.060426 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:48.061832 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-020479fd-70b0-44a0-932e-b41b72cb0089 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1338 microversion: 2.20 time: 0.163815 Jul 15 17:47:48.062957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 50/94] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:47 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1338 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:48.221629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:48.222335 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:48.266815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:48.266815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:48.266815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:48.266815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:48.800538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:48.813550 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ced4499e-77fc-4811-9b1b-df0810cc3289 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.595796 Jul 15 17:47:48.827387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 51/95] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:48 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:48.845415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:48.846149 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:48.870908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:48.878431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:48.878431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:48.878431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:49.166832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=8 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:49.279246 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:49.288961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-504f1829-912c-40dc-8216-cb2a9beb3352 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 1.465179 Jul 15 17:47:49.289825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 45/96] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:47 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:49.296369 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:49.297435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:49.306430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:49.307181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:49.308680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:49.310026 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:49.520390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:49.531302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d8b48011-d334-4b7b-9ab5-47e6dfe2e2b6 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.709792 Jul 15 17:47:49.532543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 52/97] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:48 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:49.541889 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:49.543007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:49.559799 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:49.560731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:49.561779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:49.562509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:49.678787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=38 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:50.229265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:50.245280 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:50.254635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:50.262416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fde623c0-a553-47cc-af01-8bcc8aaafc21 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.724843 Jul 15 17:47:50.272983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 53/98] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:49 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:50.290582 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:50.291252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:50.312797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.316418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:50.316418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.316418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:50.351989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:50.385895 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d7d6c57b-ecf9-4ff3-a318-a5247a26df12 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 1.088609 Jul 15 17:47:50.395830 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 46/99] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:49 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:50.409663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:50.414382 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:50.423123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.423869 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:50.424887 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.425470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:50.668567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:50.694132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5e06f331-8bcc-42e8-9888-5f7e18b2f5a2 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.422961 Jul 15 17:47:50.694132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 54/100] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:50 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:50.701390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-9f519e4d-0048-42c8-a232-2b3d3fdb4469 req-d9be584a-08c4-46f9-bf41-c2208148daea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231a65c1-ce0b-4db4-aded-c8b5cac4b91e", "tag": "24cc2383-ebc1-48df-a898-c507a890163c"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:50.723773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-9f519e4d-0048-42c8-a232-2b3d3fdb4469 req-d9be584a-08c4-46f9-bf41-c2208148daea service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.724227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-9f519e4d-0048-42c8-a232-2b3d3fdb4469 req-d9be584a-08c4-46f9-bf41-c2208148daea service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:50.753162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-9f519e4d-0048-42c8-a232-2b3d3fdb4469 req-d9be584a-08c4-46f9-bf41-c2208148daea service nova] Creating event network-changed:24cc2383-ebc1-48df-a898-c507a890163c for instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e on hv-cinder-83697 Jul 15 17:47:50.778214 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-9f519e4d-0048-42c8-a232-2b3d3fdb4469 req-d9be584a-08c4-46f9-bf41-c2208148daea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072304 Jul 15 17:47:50.779113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 55/101] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:50.793139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:50.794399 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:50.822344 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.822816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:50.823650 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:50.828901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:51.195818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=20 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:51.344483 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:51.359074 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-22badbfa-5bf9-404d-97f8-f23a2f902a5c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.578422 Jul 15 17:47:51.359666 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 56/102] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:50 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:51.370221 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:51.370839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:51.391888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:51.397233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:51.397233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:51.397233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:51.397745 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:51.402422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e765ddfa-3b94-4012-bbbd-7c1ae44f5ab0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 1.003460 Jul 15 17:47:51.402739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:51.404077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 47/103] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:50 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:51.419719 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:51.426323 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:51.456544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:51.456961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:51.462104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:51.462608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:51.480668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=100 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:51.811525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:51.837871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:51.839828 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:51.841292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0ea4ae91-175d-4b3b-925e-547ded6f68d8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.480676 Jul 15 17:47:51.842057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 57/104] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:51 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:51.851414 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:51.853709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:51.866285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:51.866767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:51.870064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:51.870064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.018531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=6 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:52.125303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:52.147284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-37b7b3cb-9c2c-4513-9d3a-4cb816f8f892 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.303198 Jul 15 17:47:52.148462 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 58/105] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:51 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:52.155281 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-fab88bbb-85f0-4f13-80f0-ff245de2748a req-0d48612b-7414-4185-81c7-476432bd0413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:52.169048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-fab88bbb-85f0-4f13-80f0-ff245de2748a req-0d48612b-7414-4185-81c7-476432bd0413 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.170280 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-fab88bbb-85f0-4f13-80f0-ff245de2748a req-0d48612b-7414-4185-81c7-476432bd0413 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.197932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-fab88bbb-85f0-4f13-80f0-ff245de2748a req-0d48612b-7414-4185-81c7-476432bd0413 service nova] Creating event network-changed:9166a97f-a925-40c2-afe2-d0e85818ecf8 for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 on hv-cinder-83697 Jul 15 17:47:52.204736 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-fab88bbb-85f0-4f13-80f0-ff245de2748a req-0d48612b-7414-4185-81c7-476432bd0413 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052973 Jul 15 17:47:52.206042 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 59/106] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:52.366710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:52.376584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2c35f834-d0a5-4cbb-a904-e76396f6573f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.971430 Jul 15 17:47:52.377182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 48/107] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:51 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:52.378463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:52.379274 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:52.388551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.389137 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.395851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.395851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.421249 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:52.424653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:52.431031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.431707 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.432843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.433454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.693012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:52.709582 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1698c63a-8585-4c17-a537-97c665d1d724 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.335498 Jul 15 17:47:52.719562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 60/108] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:52 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:52.879096 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:52.879974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:52.892709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.899755 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:52.900245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:52.900874 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.203907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:53.217172 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4f4217f6-5c19-4389-bc27-a6215cf0a7bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.801370 Jul 15 17:47:53.232384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 49/109] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:52 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:53.242024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-36431da8-4610-421a-a770-26fd890b0005 req-c6756970-1bb0-487a-8b4b-c8231b75f7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3134e969-15cb-4cac-a35d-a4543cfa8629", "tag": "67b8c883-99b9-4bdf-954c-556d88c04747"}, {"name": "network-changed", "server_uuid": "d53d07e0-4b14-4a62-aef7-3bc499d30735", "tag": "b125e202-f036-4af3-88ec-7fbd51f6ad5e"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:47:53.259007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-36431da8-4610-421a-a770-26fd890b0005 req-c6756970-1bb0-487a-8b4b-c8231b75f7ed service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.259855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-36431da8-4610-421a-a770-26fd890b0005 req-c6756970-1bb0-487a-8b4b-c8231b75f7ed service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.269855 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:53.278518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:53.284815 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-36431da8-4610-421a-a770-26fd890b0005 req-c6756970-1bb0-487a-8b4b-c8231b75f7ed service nova] Creating event network-changed:67b8c883-99b9-4bdf-954c-556d88c04747 for instance 3134e969-15cb-4cac-a35d-a4543cfa8629 on hv-cinder-83697 Jul 15 17:47:53.285608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-36431da8-4610-421a-a770-26fd890b0005 req-c6756970-1bb0-487a-8b4b-c8231b75f7ed service nova] Creating event network-changed:b125e202-f036-4af3-88ec-7fbd51f6ad5e for instance d53d07e0-4b14-4a62-aef7-3bc499d30735 on hv-cinder-83697 Jul 15 17:47:53.285818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:53.286567 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-36431da8-4610-421a-a770-26fd890b0005 req-c6756970-1bb0-487a-8b4b-c8231b75f7ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=124745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 15 17:47:53.286967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3c70a0e1-8d75-4bab-8cc1-6bb5cd7d7d44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.428257 Jul 15 17:47:53.287532 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 61/110] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:52 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:53.288353 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.289015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.290529 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.291166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.303414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.compute.rpcapi [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 15 17:47:53.307078 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] Releasing lock "compute-rpcapi-router" {{(pid=124745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 15 17:47:53.310835 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:53.311456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:53.322683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.329096 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.330513 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-68612c20-bc35-4805-b5e7-57b5881dbc28 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096388 Jul 15 17:47:53.330971 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.331420 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.331836 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 50/111] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:47:53.400690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:53.401463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:53.410193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.410638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.411420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.412086 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.532075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:53.540549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-64e1e3a0-5928-429c-bbd2-7d64998fac62 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.233047 Jul 15 17:47:53.541166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 62/112] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:53 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:53.571606 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:53.579053 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-cdfba099-65f9-409a-b1f0-e36f9c0bb189 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.188302 Jul 15 17:47:53.579626 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 51/113] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:53 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:53.728017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:53.729005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:53.740090 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.740587 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:53.741975 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:53.742425 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.198946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.216983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0f2ba38e-de0a-4a2e-a490-fefa5de9abc4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.483359 Jul 15 17:47:54.216983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 63/114] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:53 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:54.235731 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:54.236368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:54.246343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.246343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.246343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.246343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.306205 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:54.306873 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:54.314076 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.314525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.315497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.315973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.401571 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.410172 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2cd66179-a4b0-41f1-9039-638a774344a0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.178219 Jul 15 17:47:54.410908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 52/115] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:54 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:54.489949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.499735 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.501332 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.503013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-48f66c3c-fbfd-4cc7-ab8c-1fa766d74c89 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.200963 Jul 15 17:47:54.514716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 64/116] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:54 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:47:54.558705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:54.559340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:54.565554 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.565993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.567007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.567441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.597459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:54.598636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:54.605564 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.608464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.608464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:54.608464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:54.774874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.782319 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:54.787080 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7578b53e-fc58-4a9a-acb4-69c55243c868 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.232819 Jul 15 17:47:54.787896 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 53/117] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:54 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:54.797166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5d51b1ba-9f1f-44ce-8d99-835eec00db13 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.204108 Jul 15 17:47:54.803383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 65/118] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:54 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:55.223971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:55.231427 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:55.238034 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.238493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.239272 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.239710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.397564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:55.405717 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0c475cf6-c156-47b9-a723-cebf83cd482e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.186004 Jul 15 17:47:55.406278 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 54/119] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:55 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:55.427445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:55.428060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:55.434399 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.434854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.435616 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.436048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.522883 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:55.524888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:55.541019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.541019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.541019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.541019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.619194 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:55.627485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8a180b67-4734-475e-b159-98d3d6150a78 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.204193 Jul 15 17:47:55.631124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 66/120] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:55 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:55.671798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:55.679855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:55.681399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:55.682496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b1290a76-343e-4965-bc15-9d539d29fbb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.164499 Jul 15 17:47:55.683049 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 55/121] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:55 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:55.810861 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:55.820079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:55.820079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.820404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:55.820922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.821539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:55.821631 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.821631 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.827259 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.827825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:55.828732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:55.829285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.042052 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.042282 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.059081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-201ad8d7-dfbb-4fa6-9043-38f641e9a253 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.254171 Jul 15 17:47:56.064368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-061a7a9c-3947-4248-9e3e-75a4d201bffc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.248885 Jul 15 17:47:56.066943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 56/122] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:55 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:56.067815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 67/123] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:55 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:56.421835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:56.422653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:56.431223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:56.431625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.432391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:56.432849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.587305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.595089 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5d078ea7-219d-43b4-be28-2ec3312d56c3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.177119 Jul 15 17:47:56.596044 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 57/124] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:56 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:56.645140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:56.645742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:56.652635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:56.653099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.653866 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:56.654455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.702060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:56.705523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:56.714413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:56.715058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.724229 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:56.724703 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:56.852003 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.871371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c13513f6-1bda-4bf0-8856-bdf18c8fc973 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.224787 Jul 15 17:47:56.872559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 68/125] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:56 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:56.927516 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.935440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.937072 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:56.938187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-23bc298f-45bc-4380-b36f-840ce1de222d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.241535 Jul 15 17:47:56.938947 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 58/126] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:56 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:47:57.083440 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:57.084156 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:57.091179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.091627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.092389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.092902 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.102985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:57.103757 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:57.111605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.112308 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.113216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.113980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.252883 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:57.261240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-71f89f97-9841-42a9-aa66-3ce7e3fd1ed0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.162133 Jul 15 17:47:57.261990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 59/127] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:57 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:57.264436 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:57.272150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d198f648-8e66-4a36-bd58-86aa0d333ea0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.192705 Jul 15 17:47:57.272740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 69/128] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:57 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:57.613492 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:57.614213 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:57.620846 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.621420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.622179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.622612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.848430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:57.862179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-51521245-7b36-4ab0-b46b-ece2b15ac505 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.253175 Jul 15 17:47:57.874712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 60/129] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:57 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:57.896384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:57.897628 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:57.907542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.910583 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.911539 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.912657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.960320 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:57.965240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:57.971290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.971966 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:57.973171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:57.973862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:58.119407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:58.128444 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9530a386-17ec-4774-85cb-2654c52e4361 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.236923 Jul 15 17:47:58.129195 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 70/130] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:57 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:47:58.143950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:58.153513 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:58.155015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:58.156114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0bd74f55-6dca-4fdb-ad95-a13218a142b2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.202902 Jul 15 17:47:58.156683 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 61/131] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:57 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:47:58.278899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:58.279499 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:58.286586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:58.287151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:58.288166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:58.288967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:58.291597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:58.292210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:58.298473 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:58.299008 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:58.300011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:58.300630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:58.456095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:58.476036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:58.479662 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f771d946-4b98-489a-817e-cde96de09e0c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.205211 Jul 15 17:47:58.480274 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 71/132] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:58 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:58.486394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b91f3a08-7ef3-4112-821b-9f569404d3e1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.199438 Jul 15 17:47:58.488672 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 62/133] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:58 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:58.881203 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:58.881804 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:58.888399 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:58.888937 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:58.889705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:58.890043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.026067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.033462 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b773f128-c119-442e-9aa2-dd6cd6601519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.156295 Jul 15 17:47:59.034022 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 72/134] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:58 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:59.145704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:59.146236 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:59.152225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.152698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.153457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.153884 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.174398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:59.175020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:59.181720 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.182160 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.182921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.183352 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.288903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.299403 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ebb90d90-08bb-4e6f-9c16-87d795c4f25a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.157566 Jul 15 17:47:59.299983 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 63/135] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:59 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:59.316735 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.324645 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.326149 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.327243 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-aa92dac1-ef3f-48f3-afe9-f95e70faf9b4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.156788 Jul 15 17:47:59.327795 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 73/136] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:47:59 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:47:59.498233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:59.498855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:59.506964 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:47:59.508094 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:47:59.518411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.518857 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.519635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.522176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.522639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.523259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.526751 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:47:59.527543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:47:59.549000 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:59.751850 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.768824 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:47:59.777484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fa0bd833-a2e9-4f2d-abfc-12bf0ab4883b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.282995 Jul 15 17:47:59.788054 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 64/137] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:59 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:47:59.790751 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c63865e6-6ac1-4fef-924b-b802944765ea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.278478 Jul 15 17:47:59.792844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 74/138] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:47:59 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:00.055842 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:00.060089 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:00.073897 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.074709 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.075985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.081697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.087137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=100 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:00.317538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:00.318904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:00.326067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.326865 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.327863 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.328893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.351593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.361620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7341db4f-18ba-4cf2-98d2-05cb4c4c722e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.313114 Jul 15 17:48:00.362198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 65/139] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:00 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:00.381248 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:00.381897 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:00.397065 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.398679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.408859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.408859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.530765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.541245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-72c52871-c603-48e8-ad95-8a2dfa273c97 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.228148 Jul 15 17:48:00.543001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 75/140] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:00 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:00.676170 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.689493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.691545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.693082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-cd543f50-8eb7-402d-b3d6-926d1b3f2549 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.329591 Jul 15 17:48:00.693808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 66/141] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:00 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:00.796335 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:00.797116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:00.804446 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.804940 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.806487 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.806988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.809995 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:00.810704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:00.817410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.817930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.818796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:00.830224 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:00.975405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.976215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4cc27a62-a193-4829-bd53-f4e59b0cdbc1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.172338 Jul 15 17:48:00.978665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:00.978971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 67/142] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:00 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:00.997270 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2c75c46f-2b93-4081-af55-e7f446ec1183 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.205174 Jul 15 17:48:00.997981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 76/143] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:00 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:01.379087 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:01.379910 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:01.389497 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:01.390307 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:01.391319 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:01.391917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:01.557825 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:01.559125 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:01.560698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:01.565905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:01.566355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:01.567122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:01.567554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:01.568364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d9a02271-3883-4d11-b0c1-41ce4c2cb2f3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.193195 Jul 15 17:48:01.568999 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 68/144] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:01 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:01.696131 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:01.703588 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-01dd7069-e752-4328-ba48-d43a8b5bfb47 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.149909 Jul 15 17:48:01.704158 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 77/145] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:01 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:01.711990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:01.712615 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:01.718927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:01.719371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:01.720146 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:01.720579 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:01.869728 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:01.885523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:01.887242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:01.888551 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-38f0f0b9-386a-44d3-8209-6a97a471413f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.180450 Jul 15 17:48:01.889169 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 69/146] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:01 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:01.995463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:01.996070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:02.002372 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.002813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.003571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.004026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.014659 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:02.015266 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:02.021321 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.025356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.025356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.025356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.162674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:02.173887 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0904b305-4516-4561-9393-0ec7a0fe5298 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.174539 Jul 15 17:48:02.176079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 78/147] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:01 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:02.192770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:02.202504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c40eeca0-931b-49e3-b94f-231b3ffb005f tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.191607 Jul 15 17:48:02.203166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 70/148] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:02 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:02.587257 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:02.587886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:02.594233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.594675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.595452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.595884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.724509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:02.725962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:02.733869 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.734592 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.735540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.736178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.742203 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:02.753245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d7c26cdc-e4fa-4544-a782-3f740628f0c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.170660 Jul 15 17:48:02.764683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 79/149] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:02 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:02.869037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:02.876532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4aa25959-782f-4109-8fee-ff4b91db2954 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.159649 Jul 15 17:48:02.877203 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 71/150] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:02 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:02.907327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:02.907999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:02.915551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.915803 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:02.916565 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:02.917021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.060459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:03.068882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:03.070278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:03.071426 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5b597492-d07d-4f29-9707-9d47bd28790b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.168149 Jul 15 17:48:03.071976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 80/151] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:02 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:03.183781 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:03.184870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:03.191811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.193267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.193267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.193712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.301183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:03.301406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-20171b09-154f-46fd-89c0-057f489d3adf req-da445198-c717-4637-9499-d8fb67758494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66074efc-9ad1-4fff-89f6-b16920004511", "name": "network-vif-plugged", "status": "completed", "tag": "61f90384-5142-4b61-b7be-b8f00310b1fa"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:03.319176 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-20171b09-154f-46fd-89c0-057f489d3adf req-da445198-c717-4637-9499-d8fb67758494 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.321762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-20171b09-154f-46fd-89c0-057f489d3adf req-da445198-c717-4637-9499-d8fb67758494 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.355100 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-20171b09-154f-46fd-89c0-057f489d3adf req-da445198-c717-4637-9499-d8fb67758494 service nova] Creating event network-vif-plugged:61f90384-5142-4b61-b7be-b8f00310b1fa for instance 66074efc-9ad1-4fff-89f6-b16920004511 on hv-cinder-83697 Jul 15 17:48:03.361046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-20171b09-154f-46fd-89c0-057f489d3adf req-da445198-c717-4637-9499-d8fb67758494 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145107 Jul 15 17:48:03.362619 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 81/152] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:03.369043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:03.370857 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:03.377680 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.382854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.382854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.382854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.403749 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:03.422958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1c99551b-e0ce-45fa-bb12-ce2a5c24a814 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.243539 Jul 15 17:48:03.432298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 72/153] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:03 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:03.547638 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:03.555866 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-734da143-1110-4d38-9da9-e6c23eb35fe8 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.191902 Jul 15 17:48:03.556450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 82/154] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:03 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:03.773595 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:03.776608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:03.783095 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.783542 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.784325 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.784800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.893960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:03.894576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:03.902938 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.903432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.904253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:03.904725 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:03.962229 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:03.970512 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-054a9c65-7258-45e3-802f-a09c1737fc9e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.202370 Jul 15 17:48:03.971319 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 73/155] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:03 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:04.049635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:04.057715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f996e73a-b43f-4cc5-ad6d-f1ce5c0cd81d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.167698 Jul 15 17:48:04.058283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 83/156] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:03 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:04.089188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:04.089995 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:04.098239 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.098763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.099634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.100132 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.299050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:04.307755 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:04.309303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:04.310413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e1351d39-9e19-49ae-9a38-6344e7c16d15 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.225248 Jul 15 17:48:04.311016 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 74/157] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:04 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:04.439291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:04.440042 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:04.446122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.446561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.447362 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.447789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.572822 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:04.573464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:04.582756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.582756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.582756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.582756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.583224 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:04.591136 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b38d41bd-f1bb-4f04-911c-1759020d40b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.155591 Jul 15 17:48:04.597204 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 84/158] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:04 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:04.717822 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:04.725455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f0273f80-9dc0-415e-97da-2aaecea5f570 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.156524 Jul 15 17:48:04.726448 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 75/159] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:04 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:04.987460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:04.988075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:04.994587 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.995038 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:04.995853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:04.996290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.073588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:05.074207 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:05.077164 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:05.082658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.082658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.082658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.083017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.132955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.140942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-117316c2-9bff-440d-90e0-1b2b67f8575b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.157476 Jul 15 17:48:05.141504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 85/160] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:04 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:05.214264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.221783 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-266602ee-dc36-46c9-b3f1-0110683f21e3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.152063 Jul 15 17:48:05.222339 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 76/161] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:05 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:05.329003 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:05.329819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:05.336319 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.336400 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.337412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.338415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.396304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb0a814-b77c-4172-a63d-a7433a5fa972", "name": "network-vif-plugged", "status": "completed", "tag": "c0814395-782b-444b-b1d2-4b900ea9cb9c"}, {"server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "name": "network-vif-plugged", "status": "completed", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}, {"server_uuid": "231a65c1-ce0b-4db4-aded-c8b5cac4b91e", "name": "network-vif-plugged", "status": "completed", "tag": "24cc2383-ebc1-48df-a898-c507a890163c"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:05.406823 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.407287 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.422934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] Creating event network-vif-plugged:c0814395-782b-444b-b1d2-4b900ea9cb9c for instance aeb0a814-b77c-4172-a63d-a7433a5fa972 on hv-cinder-83697 Jul 15 17:48:05.423436 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] Creating event network-vif-plugged:9166a97f-a925-40c2-afe2-d0e85818ecf8 for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 on hv-cinder-83697 Jul 15 17:48:05.423925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] Creating event network-vif-plugged:24cc2383-ebc1-48df-a898-c507a890163c for instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e on hv-cinder-83697 Jul 15 17:48:05.432130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-011d42cd-7bf5-4b59-a0c3-a0514a851975 req-b1f8c604-d458-4669-8dbc-f6576e1dd8de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039362 Jul 15 17:48:05.433067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 77/162] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:48:05.490461 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.499215 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.501049 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.502347 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7005908d-e9b6-456b-9d4b-b0e1e6e8bdaa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.178228 Jul 15 17:48:05.503186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 86/163] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:05 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:05.607986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:05.608715 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:05.618125 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.619100 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.619872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.620317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.743329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:05.744488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:05.751112 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.751575 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.752361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:05.753713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:05.798028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.807121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d3876b06-58da-492f-a4f4-4a0b84ba411f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.202850 Jul 15 17:48:05.808872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 78/164] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:05 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:05.895730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:05.903558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4f93cbcc-31de-44ac-8fab-61e6038fc653 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.164156 Jul 15 17:48:05.904185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 87/165] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:05 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:06.157938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:06.158539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:06.167918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.167918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.167918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.167918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.238793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:06.240043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:06.249801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.250302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.251079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.254093 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.304128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:06.312171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9e490b7a-a001-48ca-a2fe-34724a1904c1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1367 microversion: 2.1 time: 0.157997 Jul 15 17:48:06.312767 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 79/166] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:06 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:06.402595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:06.410246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6753e8a6-3c4c-423b-97eb-476e38040381 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.175463 Jul 15 17:48:06.410840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 88/167] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:06 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:06.522006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:06.522835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:06.529478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.529919 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.530676 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.531101 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.669697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:06.685698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:06.687461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:06.689491 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-656909a1-7963-4a7f-96cc-32483bd3d84a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.171427 Jul 15 17:48:06.710588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 80/168] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:06 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:06.824957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:06.825672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:06.831851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.832302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.833092 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.833532 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.921664 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:06.922755 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:06.929335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.929829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.930595 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:06.931204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:06.970336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:06.977832 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f361d251-cecd-4395-949a-20fab969e337 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.157289 Jul 15 17:48:06.978428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 89/169] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:06 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:07.065732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:07.073776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-32e017fd-f2e0-4a7c-838e-fe7636e5cf2c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.156614 Jul 15 17:48:07.074331 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 81/170] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:06 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:07.329104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:07.329740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:07.335723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.336161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.336947 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.337409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.428977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:07.429879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:07.440684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.440684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.440684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.441569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.466712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=100 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:07.476921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:07.499489 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1314531c-763a-4e29-b752-50a9233c4d49 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1557 microversion: 2.1 time: 0.174064 Jul 15 17:48:07.512977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 90/171] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:07 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:07.512977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-101fb34f-35d0-4de0-9ee4-a90be399f96e req-89cda019-2fd7-4af6-80c6-ade25da8a498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3134e969-15cb-4cac-a35d-a4543cfa8629", "name": "network-vif-plugged", "status": "completed", "tag": "67b8c883-99b9-4bdf-954c-556d88c04747"}, {"server_uuid": "d53d07e0-4b14-4a62-aef7-3bc499d30735", "name": "network-vif-plugged", "status": "completed", "tag": "b125e202-f036-4af3-88ec-7fbd51f6ad5e"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:07.512977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:07.519509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-101fb34f-35d0-4de0-9ee4-a90be399f96e req-89cda019-2fd7-4af6-80c6-ade25da8a498 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.520089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-101fb34f-35d0-4de0-9ee4-a90be399f96e req-89cda019-2fd7-4af6-80c6-ade25da8a498 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.534671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-101fb34f-35d0-4de0-9ee4-a90be399f96e req-89cda019-2fd7-4af6-80c6-ade25da8a498 service nova] Creating event network-vif-plugged:67b8c883-99b9-4bdf-954c-556d88c04747 for instance 3134e969-15cb-4cac-a35d-a4543cfa8629 on hv-cinder-83697 Jul 15 17:48:07.535302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-101fb34f-35d0-4de0-9ee4-a90be399f96e req-89cda019-2fd7-4af6-80c6-ade25da8a498 service nova] Creating event network-vif-plugged:b125e202-f036-4af3-88ec-7fbd51f6ad5e for instance d53d07e0-4b14-4a62-aef7-3bc499d30735 on hv-cinder-83697 Jul 15 17:48:07.542811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-101fb34f-35d0-4de0-9ee4-a90be399f96e req-89cda019-2fd7-4af6-80c6-ade25da8a498 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041645 Jul 15 17:48:07.544009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 91/172] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:07.550046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:07.550627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:07.557437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.557921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.558688 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.559124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.589182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:07.596825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e9e5e27a-04ee-4680-9bf9-ef3a86846c02 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1321 microversion: 2.1 time: 0.171511 Jul 15 17:48:07.597397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 82/173] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:07 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:07.623739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:07.686300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-011cad8e-51fa-404f-a9dc-d9c075be943c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140994 Jul 15 17:48:07.686893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 92/174] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:48:07 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:07.707546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:07.708971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:07.714602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.715043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.715787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:07.716218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:07.850154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:07.859788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:07.861425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:07.862772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-693fcf8b-dc47-44f3-99c7-d4f05dc44ab2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1405 microversion: 2.20 time: 0.159020 Jul 15 17:48:07.863338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 83/175] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:07 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:48:07.996228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:07.997071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:08.005333 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.006290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.007217 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.007656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.091559 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:08.092194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:08.098746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.099193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.099951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.100377 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.267849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:08.277722 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2918394e-9ed0-40a8-8f68-92ffaaa8d1dd tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1315 microversion: 2.1 time: 0.190857 Jul 15 17:48:08.287989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 84/176] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:08 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:08.549101 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:08.557198 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9f0a3a49-d9cc-4d53-9117-0d43a33d657c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.566176 Jul 15 17:48:08.565171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 93/177] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:07 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:08.614013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:08.614714 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:08.622038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.622562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.623491 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.624018 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.780880 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:08.788511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-57a9ec17-eda7-4547-b7c7-467e8802760c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1516 microversion: 2.1 time: 0.178278 Jul 15 17:48:08.789155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 85/178] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:08 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:08.805429 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:08.806897 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:08.812984 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.813431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.814211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.814629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.837434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'flavor' on Instance uuid 231a65c1-ce0b-4db4-aded-c8b5cac4b91e {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:48:08.881144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:08.882197 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:08.894024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.894853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:08.895812 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:08.896401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.048829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:09.057043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:09.058591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:09.059777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-50ac5dcf-380a-4a00-bd86-25bc9b298174 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1596 microversion: 2.20 time: 0.182958 Jul 15 17:48:09.060335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 86/179] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:48:08 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1596 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:48:09.080113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:09.080675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:09.086654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.087104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.088710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.088969 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.217494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-af159a2b-2407-4a59-a076-8c28405ede0f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e/action" status: 200 len: 32 microversion: 2.1 time: 0.415473 Jul 15 17:48:09.236247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 94/180] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:48:08 2022] POST /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:48:09.239831 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c3a58dbf-ae0e-4de5-bd5b-a5e9f0ed4ae8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.164766 Jul 15 17:48:09.241082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 87/181] 10.222.0.57 () {60 vars in 1315 bytes} [Fri Jul 15 17:48:09 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 17:48:09.254418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:09.255297 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:09.266681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.267438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.277051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.277769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.295055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:09.295666 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:09.304542 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.304939 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.305724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.306689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.495804 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:09.512726 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-56490d53-9f28-4b3c-bd30-7c4fec69a65b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.266669 Jul 15 17:48:09.522288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 95/182] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:09 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:09.522288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-246938ca-5747-47a7-9de7-ff89e6510600 req-bb559084-78d0-420e-af74-c50720e3aec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66074efc-9ad1-4fff-89f6-b16920004511", "tag": "61f90384-5142-4b61-b7be-b8f00310b1fa"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:09.539336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-246938ca-5747-47a7-9de7-ff89e6510600 req-bb559084-78d0-420e-af74-c50720e3aec3 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.541225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-246938ca-5747-47a7-9de7-ff89e6510600 req-bb559084-78d0-420e-af74-c50720e3aec3 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.566365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-246938ca-5747-47a7-9de7-ff89e6510600 req-bb559084-78d0-420e-af74-c50720e3aec3 service nova] Creating event network-changed:61f90384-5142-4b61-b7be-b8f00310b1fa for instance 66074efc-9ad1-4fff-89f6-b16920004511 on hv-cinder-83697 Jul 15 17:48:09.573488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-246938ca-5747-47a7-9de7-ff89e6510600 req-bb559084-78d0-420e-af74-c50720e3aec3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058220 Jul 15 17:48:09.574167 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 96/183] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:09.584883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:09.585836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:09.596659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.596659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.596659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:09.596659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:09.611906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:09.620058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-88f9db85-2f4c-476c-95d7-61a4f360e252 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1503 microversion: 2.1 time: 0.328757 Jul 15 17:48:09.641870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 88/184] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:09 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:09.781267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:09.790961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4bb88489-12b4-4d6b-acb4-c57d4f747848 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.213050 Jul 15 17:48:09.792940 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 97/185] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:09 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:10.569927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:10.575841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:10.592271 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:10.592757 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:10.593895 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:10.594329 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:10.810388 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:10.811689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:10.819186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:10.820257 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:10.821713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:10.822356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:10.857111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:10.867748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-eb9c1494-fe28-41a6-a3e8-29e6c892df6f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.335617 Jul 15 17:48:10.867840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 89/186] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:10 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:11.039984 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:11.064811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-04bd6b0a-b328-4f51-8c2e-e92ccf827c1a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.248176 Jul 15 17:48:11.065463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 98/187] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:10 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:11.275930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-442bb409-a9ee-4703-80e8-fba085a482d3 req-1f529e04-b0df-404d-bd2a-4b4529042e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:11.284420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-442bb409-a9ee-4703-80e8-fba085a482d3 req-1f529e04-b0df-404d-bd2a-4b4529042e08 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:11.285304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-442bb409-a9ee-4703-80e8-fba085a482d3 req-1f529e04-b0df-404d-bd2a-4b4529042e08 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:11.297226 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-442bb409-a9ee-4703-80e8-fba085a482d3 req-1f529e04-b0df-404d-bd2a-4b4529042e08 service nova] Creating event network-changed:9166a97f-a925-40c2-afe2-d0e85818ecf8 for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 on hv-cinder-83697 Jul 15 17:48:11.302489 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-442bb409-a9ee-4703-80e8-fba085a482d3 req-1f529e04-b0df-404d-bd2a-4b4529042e08 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030321 Jul 15 17:48:11.308721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 90/188] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:11.885802 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:11.886418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:11.892657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:11.893104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:11.893866 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:11.894303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:12.037949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:12.045624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fdd49c2e-715d-4144-b9a8-b0fc3aded140 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.164659 Jul 15 17:48:12.046171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 99/189] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:11 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:12.072308 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:12.073050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:12.079574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:12.080015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:12.080868 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:12.081342 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:12.216317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:12.224873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-cdd02823-ddda-45ed-864f-6b3843f33ed2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.157317 Jul 15 17:48:12.225652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 91/190] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:12 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:13.062287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:13.062905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:13.069173 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:13.069626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:13.070397 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:13.070827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:13.203615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:13.211067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1cee511a-e1f0-4450-94a2-a2bd5d1511c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.152687 Jul 15 17:48:13.211621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 100/191] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:13 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:13.242017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:13.243161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:13.249417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:13.249866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:13.250621 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:13.251050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:13.383967 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:13.392081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-dacb1b5d-5d58-45de-bcd6-571dfd06b304 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.153917 Jul 15 17:48:13.392705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 92/192] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:13 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:14.228295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:14.229533 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:14.235699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:14.236076 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:14.236854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:14.237286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:14.365698 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:14.373835 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f627c83a-f297-4fb6-921c-f92a47dc33ba tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.149420 Jul 15 17:48:14.374407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 101/193] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:14 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:14.409278 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:14.409886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:14.416012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:14.417006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:14.417768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:14.418200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:14.546395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:14.553948 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1d881d50-9d19-4856-afc4-15765d8110b1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.148494 Jul 15 17:48:14.554512 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 93/194] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:14 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:15.391407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:15.391954 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:15.398068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:15.398516 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:15.399278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:15.399709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:15.529964 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:15.537690 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-371bde2a-9034-4d4d-a46f-55659950ef25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.150254 Jul 15 17:48:15.538258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 102/195] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:15 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:15.570420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:15.571035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:15.577928 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:15.578384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:15.579187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:15.579625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:15.713079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:15.720439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-56391797-7ece-41ae-a4f2-fbd20edc2411 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.153835 Jul 15 17:48:15.721039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 94/196] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:15 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:16.555512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:16.556139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:16.562291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:16.568048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:16.568048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:16.568048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:16.702742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:16.710222 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-90538edf-7511-4025-8830-4885228fef1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.158572 Jul 15 17:48:16.710779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 103/197] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:16 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:16.737863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:16.738479 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:16.744460 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:16.744967 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:16.745730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:16.746695 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:16.878174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:16.886465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0cd83105-5863-4544-af9a-5e4f672c5727 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1362 microversion: 2.1 time: 0.152364 Jul 15 17:48:16.887732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 95/198] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:16 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:17.727289 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:17.727951 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:17.735035 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:17.735480 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:17.736240 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:17.736697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:17.869579 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:17.877359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-edb5af08-bf23-426a-a2af-a32f30353224 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.154024 Jul 15 17:48:17.877927 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 104/199] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:17 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:17.903855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:17.904477 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:17.917247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:17.922414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:17.923379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:17.923837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:18.053105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:18.060854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-72e85c10-1512-451c-9e23-98fa202e5989 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1547 microversion: 2.1 time: 0.161434 Jul 15 17:48:18.061457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 96/200] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:17 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:18.081868 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:18.082357 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:18.088284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:18.088856 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:18.089629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:18.090615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:18.172207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-552b95c4-53e6-4128-9568-1545086a6edc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094125 Jul 15 17:48:18.172817 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 105/201] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:48:18 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:18.401706 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4525e735-df4b-4670-8f71-b24998bf8b1c"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:18.404006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:18.410593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:18.411048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:18.411803 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:18.412393 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:18.898783 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:18.900677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:18.910894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:18.912137 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:18.916841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:18.917900 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:19.106308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:19.119475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cc411469-3e3e-42dd-bd90-02c643b2aec6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.221735 Jul 15 17:48:19.119475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 106/202] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:18 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:19.649278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-5fa6bd12-6ef4-478f-8336-743e09651008 req-64ae82e2-9bd0-4ac5-98da-38ce09d5e179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3134e969-15cb-4cac-a35d-a4543cfa8629", "tag": "67b8c883-99b9-4bdf-954c-556d88c04747"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:19.661714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-5fa6bd12-6ef4-478f-8336-743e09651008 req-64ae82e2-9bd0-4ac5-98da-38ce09d5e179 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:19.662260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-5fa6bd12-6ef4-478f-8336-743e09651008 req-64ae82e2-9bd0-4ac5-98da-38ce09d5e179 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:19.692261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f49e9f6f-55b5-4cad-925e-69bb0b5998da tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "POST /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.295262 Jul 15 17:48:19.697034 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 97/203] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:48:18 2022] POST /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972/os-volume_attachments => generated 194 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:48:19.697620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-5fa6bd12-6ef4-478f-8336-743e09651008 req-64ae82e2-9bd0-4ac5-98da-38ce09d5e179 service nova] Creating event network-changed:67b8c883-99b9-4bdf-954c-556d88c04747 for instance 3134e969-15cb-4cac-a35d-a4543cfa8629 on hv-cinder-83697 Jul 15 17:48:19.712935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-5fa6bd12-6ef4-478f-8336-743e09651008 req-64ae82e2-9bd0-4ac5-98da-38ce09d5e179 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067968 Jul 15 17:48:19.721715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 107/204] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:20.133944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:20.135851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:20.164486 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:20.165281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:20.169711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:20.172521 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:20.406779 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:20.416977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:20.421480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-cce29e26-ebeb-4e0d-a9e8-92a615ee1869 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.291987 Jul 15 17:48:20.423378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 98/205] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:20 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:21.440346 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:21.441084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:21.447410 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:21.447901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:21.448876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:21.449318 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:21.589143 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:21.596674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c1b8e5b7-7674-4e6c-b487-b17a677ce0d2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.160560 Jul 15 17:48:21.597238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 108/206] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:21 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:22.615084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:22.615698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:22.627497 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:22.628154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:22.629188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:22.629777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:22.776793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:22.786368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-789005fa-734d-4ae4-ae29-368171c79ac3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.176151 Jul 15 17:48:22.797115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 99/207] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:22 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:23.803282 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:23.803908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:23.810171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:23.810614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:23.811432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:23.811872 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:23.816036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:23.939585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:23.946903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7c4dfe07-f88d-41e3-9d61-c8d38d6b4233 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.147503 Jul 15 17:48:23.947502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 109/208] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:23 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:24.978117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:24.978790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:24.989761 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:24.990295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:24.991377 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:24.991866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:25.128426 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:25.139182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-21e7d827-7797-4a06-a6db-866f3dd6204c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.163945 Jul 15 17:48:25.139182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 100/209] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:24 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:26.155975 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:26.156731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:26.163633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:26.164331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:26.165140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:26.165572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:26.321927 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:26.330186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-89c19fac-aa2c-44bc-83c3-ae1747411db5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.178904 Jul 15 17:48:26.330838 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 110/210] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:26 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:27.348290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:27.348917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:27.355782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:27.356170 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:27.356978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:27.357416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:27.500420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:27.508187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ff9e7c9b-9076-426a-a2d3-00926ca06528 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.163681 Jul 15 17:48:27.508770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 101/211] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:27 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:28.525526 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:28.535422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:28.550481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:28.550941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:28.555799 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:28.555799 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:28.760749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:28.768460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5405d490-4421-4868-ba2d-af4f35bdbb91 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.247173 Jul 15 17:48:28.771145 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 111/212] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:28 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:29.525080 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:29.525612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:29.537746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:29.538126 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:29.538953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:29.539363 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:29.566617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:48:29.787066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:29.787869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:29.793811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:29.794557 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:29.795317 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:29.796489 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:29.899557 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-338442dd-898d-4f55-9906-8d407bf4cf92 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "DELETE /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 204 len: 0 microversion: 2.1 time: 0.377956 Jul 15 17:48:29.900882 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 102/213] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:48:29 2022] DELETE /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:48:29.916677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:29.917249 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:29.924850 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:29.929455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:29.929455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:29.929455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:29.933215 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:29.942131 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f1508ac2-409c-4e11-b4de-8b4b60daaaf6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.158931 Jul 15 17:48:29.942869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 112/214] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:29 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:30.066083 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:30.074898 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-49dc5bb1-5ef4-447b-8409-835c2d23cc3d tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1555 microversion: 2.1 time: 0.170381 Jul 15 17:48:30.075828 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 103/215] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:29 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:30.958772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:30.959300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:30.965471 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:30.965924 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:30.966687 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:30.967125 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:31.093636 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:31.094321 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:31.099031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:31.101107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:31.101658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:31.102437 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:31.102908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:31.107185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-14eaa31b-7e4b-4d71-8834-f28d40d6a05a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.152239 Jul 15 17:48:31.107767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 113/216] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:30 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:31.238410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:31.246377 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-229f03eb-5c36-42f5-92b4-45f6ae0e405c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1555 microversion: 2.1 time: 0.157226 Jul 15 17:48:31.246949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 104/217] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:31 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:32.124728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:32.125349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:32.131755 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:32.132209 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:32.133014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:32.133455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:32.262223 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:32.263847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:32.265433 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:32.270685 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-de7b7f04-6321-489d-8de9-c45b2b4979fa tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.149735 Jul 15 17:48:32.271345 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 114/218] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:32 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:32.271495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:32.271793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:32.272726 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:32.273226 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:32.418526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:32.427940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a7fcba53-a925-4638-9cae-69dcfc9836e0 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1555 microversion: 2.1 time: 0.167917 Jul 15 17:48:32.428523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 105/219] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:32 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:33.288623 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:33.289235 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:33.296033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:33.301852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:33.301852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:33.301852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:33.438133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:33.446830 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:33.447533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:33.448366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2ee069d9-f0aa-4272-ac80-d13a3c747eec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.163659 Jul 15 17:48:33.450063 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 115/220] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:33 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:33.463315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:33.463925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:33.465148 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:33.466367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:33.605820 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:33.609627 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-49aaa9a3-71c1-49d3-814e-141f4b852c02 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1555 microversion: 2.1 time: 0.168189 Jul 15 17:48:33.610335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 106/221] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:33 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:34.466682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:34.467858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:34.474188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:34.474631 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:34.475395 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:34.475833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:34.627003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:34.627521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:34.628397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:34.636759 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ed38f7a8-fc0d-43d2-9195-355542e6f33d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.173076 Jul 15 17:48:34.645709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 116/222] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:34 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:34.651458 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:34.652292 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:34.657323 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:34.658957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:34.965774 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:34.976275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e544c9d6-65af-4511-92a0-dc6482de534b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1555 microversion: 2.1 time: 0.353350 Jul 15 17:48:34.986795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 107/223] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:34 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1555 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:35.485934 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-9bc2aa02-b864-4de3-ab3c-1a6fedf2a92a req-92e79ee2-ae8b-405c-ba29-df5d222554e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb0a814-b77c-4172-a63d-a7433a5fa972", "name": "network-vif-deleted", "tag": "c0814395-782b-444b-b1d2-4b900ea9cb9c"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:35.498186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-9bc2aa02-b864-4de3-ab3c-1a6fedf2a92a req-92e79ee2-ae8b-405c-ba29-df5d222554e2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:35.499481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-9bc2aa02-b864-4de3-ab3c-1a6fedf2a92a req-92e79ee2-ae8b-405c-ba29-df5d222554e2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:35.511598 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-9bc2aa02-b864-4de3-ab3c-1a6fedf2a92a req-92e79ee2-ae8b-405c-ba29-df5d222554e2 service nova] Creating event network-vif-deleted:c0814395-782b-444b-b1d2-4b900ea9cb9c for instance aeb0a814-b77c-4172-a63d-a7433a5fa972 on hv-cinder-83697 Jul 15 17:48:35.517719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-9bc2aa02-b864-4de3-ab3c-1a6fedf2a92a req-92e79ee2-ae8b-405c-ba29-df5d222554e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Jul 15 17:48:35.518409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 117/224] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:48:35.653247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:35.653856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:35.660341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:35.660840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:35.661606 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:35.662049 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:35.790882 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:35.798890 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-41bc0c3c-5610-4703-8d1c-71366c49b493 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.149418 Jul 15 17:48:35.799454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 108/225] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:35 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:35.994193 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:35.994949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:36.002016 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:36.002723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:36.003653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:36.004084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:36.069389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:36.082770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c235a21c-6d62-43b5-9433-f28c15b2142b tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1513 microversion: 2.1 time: 0.092618 Jul 15 17:48:36.093180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 118/226] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:35 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:36.820988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:36.820988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:36.829177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:36.830008 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:36.831018 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:36.831526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:37.100811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:37.101355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:37.107626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:37.108115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:37.108929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:37.109368 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:37.184069 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:37.184614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:37.192717 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2025ab7a-b4f9-42b9-b16b-59705d018f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1522 microversion: 2.1 time: 0.378721 Jul 15 17:48:37.193796 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8b51dcf9-8535-49b7-89ee-5146154f2d08 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1346 microversion: 2.1 time: 0.097054 Jul 15 17:48:37.195071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 119/227] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:37 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:37.204123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 109/228] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:36 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:38.218999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:38.221026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:38.221544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:38.224568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:38.230539 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.231955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.233748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.233748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.234322 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:38.235988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.236616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.237565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.238154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.274472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.274977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.275653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lazy-loading 'fault' on Instance uuid aeb0a814-b77c-4172-a63d-a7433a5fa972 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:48:38.343509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c230254925a43ac9fe52dffbd0fe3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f83741fb5241efad1b22e93cc67450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:38.351579 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b105b85e-05b3-4912-acb0-a20de7ee2118 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 200 len: 1351 microversion: 2.1 time: 0.142514 Jul 15 17:48:38.352149 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 110/229] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:38 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 1351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:38.396285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:38.403739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8d201d63-fbcc-48fe-8f7f-08920becab48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1502 microversion: 2.1 time: 0.195620 Jul 15 17:48:38.404307 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 120/230] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:38 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:38.420076 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:38.421434 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:38.427637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.428086 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.428871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:38.429303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:38.584401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:38.592659 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-11768207-461c-4450-b095-ec47f1936f99 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1514 microversion: 2.1 time: 0.176003 Jul 15 17:48:38.593227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 111/231] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:38 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:39.374627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:39.375205 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:39.377469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=59 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:39.383537 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:39.384419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:39.385744 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:39.386667 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:39.404288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] HTTP exception thrown: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Request method failure captured: Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 HTTP/1.1 Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agqbiPcBMMlii8O81IOosqnCRzVKhB0O7nleRlouPVEU0dtMdUtqv0Tatjs8I86-Vmhq5jGxmfmPCJ6L1bg1YFM2QWFaLinKiOb-OZLXtvX03JaZxEB6rCZgFZzChFCJBG_Y6q1r8MoxHzuhg8uejWGqek2wVMIp1YuWx95K6ybq8U Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:48:39.411633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_70f83741fb5241efad1b22e93cc67450", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}] Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 1c230254925a43ac9fe52dffbd0fe3ed Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.413184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'aeb0a814-b77c-4172-a63d-a7433a5fa972'} Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:48:39.413841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.414918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.416044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Returning 404 to user: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:48:39.416044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0d2b31d0-a426-45a5-b965-67a23d41b17c tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 404 len: 111 microversion: 2.1 time: 0.043271 Jul 15 17:48:39.417667 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 121/232] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:39 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:48:39.551015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:39.552913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:39.559558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:39.560002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:39.561489 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:39.562451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:39.577626 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] HTTP exception thrown: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Request method failure captured: Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972/os-volume_attachments HTTP/1.1 Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agqbiPcBMMlii8O81IOosqnCRzVKhB0O7nleRlouPVEU0dtMdUtqv0Tatjs8I86-Vmhq5jGxmfmPCJ6L1bg1YFM2QWFaLinKiOb-OZLXtvX03JaZxEB6rCZgFZzChFCJBG_Y6q1r8MoxHzuhg8uejWGqek2wVMIp1YuWx95K6ybq8U Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:48:39.581857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_70f83741fb5241efad1b22e93cc67450", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}] Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 1c230254925a43ac9fe52dffbd0fe3ed Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.583231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'server_id': 'aeb0a814-b77c-4172-a63d-a7433a5fa972'} Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:48:39.584158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:39.585416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:39.587400 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Returning 404 to user: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:48:39.588420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-80226e7d-5d11-4b07-bca1-7d1354d1f3a1 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041726 Jul 15 17:48:39.593408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 112/233] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:48:39 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:48:40.584963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:48:40.585917 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:40.593052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:40.593389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:40.594165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:40.594607 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:40.619654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'flavor' on Instance uuid d53d07e0-4b14-4a62-aef7-3bc499d30735 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:48:41.075817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:41.076376 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:41.082950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:41.083405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:41.085689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:41.085689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:41.098392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] HTTP exception thrown: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Request method failure captured: Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: DELETE /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 HTTP/1.1 Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agqbiPcBMMlii8O81IOosqnCRzVKhB0O7nleRlouPVEU0dtMdUtqv0Tatjs8I86-Vmhq5jGxmfmPCJ6L1bg1YFM2QWFaLinKiOb-OZLXtvX03JaZxEB6rCZgFZzChFCJBG_Y6q1r8MoxHzuhg8uejWGqek2wVMIp1YuWx95K6ybq8U Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:48:41.100503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_70f83741fb5241efad1b22e93cc67450", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}] Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 1c230254925a43ac9fe52dffbd0fe3ed Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.101756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'aeb0a814-b77c-4172-a63d-a7433a5fa972'} Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:48:41.102561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.104494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.107020 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Returning 404 to user: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:48:41.107020 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-14735d41-0b78-449c-be49-358b96f3ead9 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "DELETE /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 404 len: 111 microversion: 2.1 time: 0.030080 Jul 15 17:48:41.107020 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 113/234] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:48:41 2022] DELETE /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:48:41.111458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-01e4639d-e94c-4565-a3c7-50ed5fa47b09 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/action" status: 200 len: 32 microversion: 2.1 time: 0.530508 Jul 15 17:48:41.112060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 122/235] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:48:40 2022] POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:48:41.115608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:41.118511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] [instance: aeb0a814-b77c-4172-a63d-a7433a5fa972] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:41.127479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:41.128193 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:41.135144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:41.135825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:41.136810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:41.136930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:41.137301 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:41.137690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:41.138413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:41.142708 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:41.162417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] HTTP exception thrown: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Request method failure captured: Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 HTTP/1.1 Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agqbiPcBMMlii8O81IOosqnCRzVKhB0O7nleRlouPVEU0dtMdUtqv0Tatjs8I86-Vmhq5jGxmfmPCJ6L1bg1YFM2QWFaLinKiOb-OZLXtvX03JaZxEB6rCZgFZzChFCJBG_Y6q1r8MoxHzuhg8uejWGqek2wVMIp1YuWx95K6ybq8U Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:48:41.165468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/70f83741fb5241efad1b22e93cc67450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_70f83741fb5241efad1b22e93cc67450", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/70f83741fb5241efad1b22e93cc67450"}]}] Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 70f83741fb5241efad1b22e93cc67450 Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467454824 Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 1c230254925a43ac9fe52dffbd0fe3ed Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-DeleteServersTestJSON-1467454824-project Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.167074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'aeb0a814-b77c-4172-a63d-a7433a5fa972'} Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:48:41.167944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. Jul 15 17:48:41.169242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:48:41.172154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] Returning 404 to user: Instance aeb0a814-b77c-4172-a63d-a7433a5fa972 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:48:41.174457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ec897e6b-5b4f-4c08-aa0e-c671d6d14913 tempest-DeleteServersTestJSON-1467454824 tempest-DeleteServersTestJSON-1467454824-project] 10.222.0.57 "GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972" status: 404 len: 111 microversion: 2.1 time: 0.067778 Jul 15 17:48:41.175171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 114/236] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:41 2022] GET /compute/v2.1/servers/aeb0a814-b77c-4172-a63d-a7433a5fa972 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:48:41.326385 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:41.336324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-62e9d0b8-02e2-4ef5-8f00-c984a29e9913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.213876 Jul 15 17:48:41.337070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 123/237] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:41 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:42.356827 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:42.357908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:42.365551 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:42.365994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:42.366761 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:42.367194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:42.398123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:42.648232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:42.656441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-aeb32094-b94f-4345-b884-f9bcdfe67940 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.304865 Jul 15 17:48:42.657431 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 115/238] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:42 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:43.682770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:43.683464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:43.695841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:43.696369 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:43.697365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:43.702069 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:43.875300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:43.893469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e347bf20-4706-40da-995c-bb5db0d143c1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.219756 Jul 15 17:48:43.896693 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 124/239] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:43 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:44.925821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:44.926468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:44.934911 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:44.935365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:44.936974 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:44.937577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:45.092679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:45.101464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-233eb9b0-ff41-4786-93f2-e9b7f2ab9ae9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.179534 Jul 15 17:48:45.102089 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 116/240] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:44 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:46.121299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:46.121904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:46.134055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:46.134055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:46.134055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:46.134055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:46.135326 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:46.370075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:46.384287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-69e0f3db-c7c9-4d1a-913f-70940c4065d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.269805 Jul 15 17:48:46.385614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 125/241] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:46 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:47.413494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:47.413494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:47.414716 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:47.414716 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:47.415255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:47.415578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:47.617901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:47.644490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ed92b4be-6b5c-4a03-892f-f3661f520017 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.246438 Jul 15 17:48:47.646035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 117/242] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:47 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:48.661723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:48.662331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:48.669200 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:48.669649 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:48.670529 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:48.671014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:48.814770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:48.822831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c8b70a42-1482-4c80-a03d-07d058efa78e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.164956 Jul 15 17:48:48.823877 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 126/243] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:48 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:49.839697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:49.840316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:49.847666 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:49.848121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:49.848948 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:49.849392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:50.002603 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:50.011036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-65e69974-c0e3-4b50-baf9-be6b460e8102 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.175168 Jul 15 17:48:50.011602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 118/244] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:49 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:51.029120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:51.029771 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:51.036293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:51.036780 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:51.037591 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:51.038082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:51.181978 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:51.189885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-26d2fa3c-8cef-47b8-8da3-23a26af1a9dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.165811 Jul 15 17:48:51.190454 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 127/245] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:51 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:52.207268 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:52.207986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:52.214730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:52.215105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:52.215921 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:52.216388 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:52.376984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:52.389257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-57d3eccb-d93f-463c-92b4-5734e13e1500 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.184373 Jul 15 17:48:52.397190 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 119/246] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:52 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:53.413845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:53.414458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:53.422194 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:53.422652 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:53.423458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:53.423954 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:53.608366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:53.615929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b0e8e5b8-dc28-484e-a532-9fd4ea00e9d3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.206100 Jul 15 17:48:53.616576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 128/247] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:53 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:48:54.634712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:54.635381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:54.642404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:54.642882 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:54.643652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:54.644084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:54.776876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:54.785345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d9e1b81e-fa67-423b-ae92-a53e50b80458 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.154772 Jul 15 17:48:54.785923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 120/248] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:54 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:55.802831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:55.803521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:55.809798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:55.814809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:55.814809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:55.814809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:56.253844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:56.261742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cebe397e-5294-47d4-86d0-e54952e7c955 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.462909 Jul 15 17:48:56.262317 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 129/249] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:55 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:57.280331 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:57.290463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:57.290463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:57.290463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:57.290463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:57.291166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:57.432115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:57.441288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-df9e655d-63b9-41ac-a8ab-df59dabd6a70 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.166389 Jul 15 17:48:57.448983 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 121/250] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:57 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:57.967006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:57.967492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:57.973680 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:57.974131 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:57.974895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:57.975330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:57.999243 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7851dbb4-959e-46f3-90c4-88104ecd80f8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/ips" status: 200 len: 151 microversion: 2.20 time: 0.036285 Jul 15 17:48:57.999836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 130/251] 10.222.0.57 () {60 vars in 1288 bytes} [Fri Jul 15 17:48:57 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:48:58.460392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:58.461164 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:58.468403 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:58.472104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:58.472104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:58.472104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:58.609333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:58.617171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7b2be862-4c8f-4339-88b6-1d6cd8294c94 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.160778 Jul 15 17:48:58.617727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 122/252] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:58 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:48:59.635365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:48:59.636025 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:48:59.642850 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:59.643288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:59.644046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:48:59.644472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:48:59.789273 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:48:59.798955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-93b5fc67-5179-48a7-b4f8-f4740c175de5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.167358 Jul 15 17:48:59.799823 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 131/253] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:48:59 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:00.816250 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:00.817309 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:00.829129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:00.829676 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:00.830741 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:00.831457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:00.990152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:00.997677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0ae10156-44a2-4665-a7fe-d72f539009b3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.186479 Jul 15 17:49:00.998262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 123/254] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:00 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:02.020987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:02.021643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:02.028843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:02.029351 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:02.030604 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:02.030821 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:02.087688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:02.089002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:02.096546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:02.097033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:02.097836 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:02.103257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:02.121793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lazy-loading 'flavor' on Instance uuid a1eee81c-2157-4056-bb4c-8e7a628d96b9 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:49:02.196503 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:02.207835 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f16e8144-124c-4689-9f87-db19edf81535 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.194836 Jul 15 17:49:02.208439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 132/255] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:02 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:02.891551 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d56a47d2-5d0b-4cb3-a283-918d3f3abf01 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/action" status: 202 len: 0 microversion: 2.20 time: 0.807802 Jul 15 17:49:02.892213 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 124/256] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 15 17:49:02 2022] POST /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:49:02.900620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:02.901228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:02.907950 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:02.908515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:02.910382 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:02.911298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:03.046139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:03.056136 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:03.057778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:03.065611 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cfa9bdc0-b268-45fa-a305-1b8d9731f387 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.162521 Jul 15 17:49:03.065611 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 133/257] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:02 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:03.226033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:03.226756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:03.233556 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:03.234039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:03.235058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:03.235508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:03.417881 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:03.427060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8e095dee-1edb-4e69-84a5-a8ce31a321a5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.205799 Jul 15 17:49:03.427773 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 125/258] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:03 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:04.078539 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:04.079130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:04.085184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:04.085635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:04.086398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:04.086893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:04.220336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:04.228663 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:04.231327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:04.235647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-265d3c57-98bd-4933-9b74-9c0f4d4e5c3f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.158469 Jul 15 17:49:04.235647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 134/259] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:04 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:04.443727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:04.444352 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:04.450805 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:04.451060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:04.451951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:04.452254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:04.588314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:04.596547 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f01b67b1-a500-41e7-b846-dd605260cd2f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.156969 Jul 15 17:49:04.597137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 126/260] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:04 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:05.252161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:05.252911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:05.267401 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:05.267884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:05.269104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:05.269493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:05.423818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:05.431702 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:05.433233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:05.434382 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0effa3bb-01c1-4a39-ab88-b84f8131c4e1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.187041 Jul 15 17:49:05.434931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 135/261] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:05 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:05.613871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:05.614517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:05.621298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:05.621745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:05.622521 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:05.622957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:05.789894 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:05.807623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e4580647-ba83-4b0b-8a1d-6ab499d9d985 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.197339 Jul 15 17:49:05.808209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 127/262] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:05 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:06.460375 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:06.461981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:06.469766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:06.470284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:06.471069 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:06.471515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:06.537841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:06.538638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:06.544902 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:06.545530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:06.546452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:06.547069 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:06.578747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2c28ea67-8c09-46bf-a9a0-35310de1a00a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/ips" status: 200 len: 150 microversion: 2.1 time: 0.043528 Jul 15 17:49:06.584917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 128/263] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:49:06 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:06.653594 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:06.664449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:06.666083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:06.667322 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-bc83c8a8-cb9d-42dd-a79a-a90fa5ae672a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.215704 Jul 15 17:49:06.668639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 136/264] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:06 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:06.824408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:06.825535 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:06.833432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:06.834156 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:06.835411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:06.835996 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:06.989210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:06.996824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f054e4f6-a7dd-4807-b9f4-d2008426849d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1500 microversion: 2.1 time: 0.176134 Jul 15 17:49:06.997392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 129/265] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:06 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1500 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:07.014769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dafc1c8-e3bf-49d1-936a-081aaa11bfcc"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:07.015991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:07.022051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.022493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.023255 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.023722 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.048300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] HTTP exception thrown: Cannot 'attach_volume' instance d53d07e0-4b14-4a62-aef7-3bc499d30735 while it is in vm_state rescued Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Request method failure captured: Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/os-volume_attachments HTTP/1.1 Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 74 Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aguD8a54fCYXtt_8xQTS9O_epgiN-k-ksFDGtFTfK1PazWjUqu_K0Ie0Beu1FE2Cuvy-u1Y33ciAtRXlbauO8FGqg1zJ7p58sAwkO_0EjuoIaWc_HKOAbSx8a3Tb4F2dtx8-Gx2bXpyVWoWdRgPnm_nUOEDByLRwt7XvRrV2TUbOZ4 Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:49:07.050299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/882c7039b37f45f8843752b457525d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_882c7039b37f45f8843752b457525d9b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}] Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 8873b1c9f58a4adea93ebe21f5f3263d Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {"volumeAttachment": {"volumeId": "1dafc1c8-e3bf-49d1-936a-081aaa11bfcc"}} Jul 15 17:49:07.051798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Cannot 'attach_volume' instance d53d07e0-4b14-4a62-aef7-3bc499d30735 while it is in vm_state rescued Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'server_id': 'd53d07e0-4b14-4a62-aef7-3bc499d30735', 'body': {'volumeAttachment': {'volumeId': '1dafc1c8-e3bf-49d1-936a-081aaa11bfcc'}}} Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:49:07.052743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d53d07e0-4b14-4a62-aef7-3bc499d30735 while it is in vm_state rescued Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:49:07.054056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d53d07e0-4b14-4a62-aef7-3bc499d30735 while it is in vm_state rescued Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Returning 409 to user: Cannot 'attach_volume' instance d53d07e0-4b14-4a62-aef7-3bc499d30735 while it is in vm_state rescued {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3b34c5ce-8625-48a6-8f60-9d1d45e992a6 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041145 Jul 15 17:49:07.055306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 137/266] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:49:07 2022] POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 15 17:49:07.061258 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:07.061854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:07.071114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.071114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.071114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.071114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.088170 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:07.352476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-922f9030-7c5f-4773-99f1-dc35a5127c58 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/action" status: 202 len: 0 microversion: 2.1 time: 0.294567 Jul 15 17:49:07.353710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 130/267] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:49:07 2022] POST /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:49:07.364016 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:07.364712 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:07.375432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.375432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.375432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.375796 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.574215 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:07.583193 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-18e6990f-d746-41fb-9abd-5a48a9adea35 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1508 microversion: 2.1 time: 0.224151 Jul 15 17:49:07.583761 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 138/268] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:07 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:07.687530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:07.688372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:07.695588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.696243 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:07.697142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:07.697730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:08.146295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:08.153317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:08.154930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:08.157457 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-754a1811-5cb0-4987-9a1a-f8ffe4524f1f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.474217 Jul 15 17:49:08.176970 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 131/269] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:07 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:08.525059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c70e0b-8915-4fdc-84f2-591d136e8476"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:08.526403 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:08.533133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:08.533800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:08.534720 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:08.535655 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:08.601908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:08.602525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:08.611766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=46 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:08.613536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:08.613982 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:08.614755 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:08.615183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:08.919201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:08.927737 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-30263818-4026-4f77-a7fe-7f7c1f40f69e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1508 microversion: 2.1 time: 0.330007 Jul 15 17:49:08.928526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 132/270] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:08 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:09.183536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:09.184222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:09.191191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:09.191640 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:09.192411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:09.192881 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:09.350455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:09.358789 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:09.360896 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:09.362069 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3102610c-fdc5-4455-a413-f48ca459723f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.182420 Jul 15 17:49:09.362920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 133/271] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:09 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:09.945564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:09.946721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:09.955843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:09.956314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:09.957425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:09.957968 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:10.119425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:10.127838 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-851431c4-aa12-43ab-a089-913eb1fbc0dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1508 microversion: 2.1 time: 0.186168 Jul 15 17:49:10.128424 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 134/272] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:09 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:10.383612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:10.385724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:10.396684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:10.397147 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:10.398380 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:10.398973 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:10.592650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:10.601493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:10.603209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:10.604394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7b900596-7285-4c32-9895-5ccaa708a42c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.225354 Jul 15 17:49:10.605032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 135/273] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:10 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:11.116116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4fa55418-31b5-4454-b8ae-44952f425399 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.595015 Jul 15 17:49:11.120245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 139/274] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:49:08 2022] POST /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments => generated 194 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:11.154036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:11.154036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:11.161163 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:11.164378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:11.165245 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:11.165809 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:11.492394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:11.500494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-29a678d1-b239-4d79-b29a-12f69665bea9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1508 microversion: 2.1 time: 0.354300 Jul 15 17:49:11.501125 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 136/275] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:11 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:11.624762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:11.625354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:11.628554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=38 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:11.633816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:11.633816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:11.633816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:11.634309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:11.801792 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:11.814276 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:11.815895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:11.824945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-45887ee3-9f2f-4138-912f-44e2fcfaa323 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.197529 Jul 15 17:49:11.824945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 140/276] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:11 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:12.518729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:12.519369 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:12.525648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:12.526103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:12.526905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:12.527345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:12.658821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:12.666590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-96509726-d0ea-41aa-a734-bd8d6f0db077 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1508 microversion: 2.1 time: 0.152114 Jul 15 17:49:12.667255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 137/277] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:12 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:12.841438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:12.842301 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:12.849706 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:12.850160 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:12.850933 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:12.851371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:12.855363 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:13.038879 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:13.047422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:13.049918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:13.051550 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b13d308b-3884-4777-877e-5ebea2dea2e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.214039 Jul 15 17:49:13.052533 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 141/278] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:12 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:13.685836 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:13.686450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:13.693568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:13.694024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:13.694802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:13.695300 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:13.916166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:13.924508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fbb3425e-0bc6-4b49-9387-7891c3d069bf tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1508 microversion: 2.1 time: 0.242388 Jul 15 17:49:13.925115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 138/279] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:13 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:14.072973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:14.073665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:14.081001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:14.081397 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:14.082208 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:14.082642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:14.233894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:14.242710 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:14.244160 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:14.245451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-02682144-9815-4da5-a73c-4f665cbbd0cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.177355 Jul 15 17:49:14.256632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 142/280] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:14 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:14.915663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:14.916223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:14.925708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:14.928485 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:14.929875 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:14.931244 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:14.946576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:14.947331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:14.954739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:14.955190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:14.956241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:14.956765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:14.960397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1afb0090-180e-49f7-8fb9-1e09a09da2c2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/ips" status: 200 len: 144 microversion: 2.1 time: 0.048772 Jul 15 17:49:14.961011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 139/281] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:49:14 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/ips => generated 144 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:15.096054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:15.106079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b84a42c6-7858-4b7d-aaf5-870e05133d05 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1514 microversion: 2.1 time: 0.163871 Jul 15 17:49:15.106719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 143/282] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:14 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:15.266272 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:15.266889 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:15.272941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:15.273401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:15.274161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:15.274602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:15.415546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:15.424228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:15.425817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:15.426979 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2c042a2d-b6cd-47ed-b7e9-2f7559bb7743 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.164687 Jul 15 17:49:15.427541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 140/283] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:15 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:16.444522 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:16.445158 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:16.451504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:16.451787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:16.452558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:16.453292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:16.595587 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:16.608119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:16.611772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:16.613279 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a71fc744-b9cb-4142-a028-5d3bc4ff42a0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.172435 Jul 15 17:49:16.624814 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 144/284] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:16 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:17.181454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3eaf66bb-df37-4957-9b30-7709766167f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'create', calling method: .version_select at 0x7f37d169f9d0>, body: {"keypair": {"name": "tempest-keypair-1702794431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVzLXeX7b8Cmk1/m5TqRP8+jxzgvIIwtAeLf5iG97cPEXCkY/Eo3qiYOtkol0NRaMDNvUfDysbNF4DbWBl0rYcYMDL/Fp0xgsq6sWnWBYnMmoXitGmcxgZPiFoNDBzjAQ=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:17.196208 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-3eaf66bb-df37-4957-9b30-7709766167f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for project 882c7039b37f45f8843752b457525d9b. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:49:17.200048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-3eaf66bb-df37-4957-9b30-7709766167f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for user 8873b1c9f58a4adea93ebe21f5f3263d and project 882c7039b37f45f8843752b457525d9b. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:49:17.340185 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3eaf66bb-df37-4957-9b30-7709766167f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162762 Jul 15 17:49:17.340999 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 141/285] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:49:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:17.635638 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:17.636314 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:17.643758 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:17.644315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:17.645178 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:17.645719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:17.782804 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:17.799699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:17.802057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:17.803407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9318aa88-0b8e-43c6-8fad-7fedbc60f203 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.172548 Jul 15 17:49:17.804148 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 145/286] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:17 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:18.649048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10309093-fb36-4621-ae32-4ef0a35c6997"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:18.650143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:18.657055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:18.657499 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:18.658271 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:18.658705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:18.823287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:18.824064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:18.832115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:18.832585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:18.836760 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:18.837258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:19.078983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:19.090882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:19.094939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:19.097464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3a63caef-be5f-4e37-a8f8-10801375e665 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.278554 Jul 15 17:49:19.109620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 146/287] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:18 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:19.636126 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-060625be-7d11-4587-831e-6f0b1695444d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991790 Jul 15 17:49:19.636798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 142/288] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:49:18 2022] POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:20.118369 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:20.119031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:20.126139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:20.126679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:20.127452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:20.127887 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:20.360516 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-994814480", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b5e5652-3efb-4c6e-8f01-1ea55e108f86"}], "security_groups": [{"name": "tempest-securitygroup--1568361468"}], "key_name": "tempest-keypair-1702794431", "user_data": "}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:20.421959 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:20.430625 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:20.432248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:20.433457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-420521e1-09ca-4363-bd79-30db3bc23162 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1742 microversion: 2.20 time: 0.319146 Jul 15 17:49:20.434002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 147/289] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:20 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1742 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:20.465781 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] validate_networks() for [('5b5e5652-3efb-4c6e-8f01-1ea55e108f86', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:49:20.882263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:49:20.882698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:49:20.883199 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:49:20.883610 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:49:20.884023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:49:20.893553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:20.894001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:20.894907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:20.895347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:20.913676 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for project 882c7039b37f45f8843752b457525d9b. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:49:20.920261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Getting quotas for user 8873b1c9f58a4adea93ebe21f5f3263d and project 882c7039b37f45f8843752b457525d9b. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:49:20.940031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:49:20.943175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:49:21.215524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f20989a0-73f5-42f5-91cf-9446d3221bea tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.860008 Jul 15 17:49:21.216186 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 143/290] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:49:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:49:21.229988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0e73e1e2-d169-4b8e-8850-2ac9fb65e532 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:21.230610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0e73e1e2-d169-4b8e-8850-2ac9fb65e532 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:21.293850 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0e73e1e2-d169-4b8e-8850-2ac9fb65e532 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:21.298562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0e73e1e2-d169-4b8e-8850-2ac9fb65e532 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1245 microversion: 2.1 time: 0.072738 Jul 15 17:49:21.299112 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 148/291] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:21 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:21.452835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:21.453438 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:21.461557 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:21.462056 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:21.463097 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:21.463530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:21.615156 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:21.623810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:21.626293 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:21.627281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7661f628-f257-4647-ae71-15ce7bdd4637 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1742 microversion: 2.20 time: 0.178629 Jul 15 17:49:21.627837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 144/292] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:21 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:22.315876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:22.316487 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:22.323750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:22.324197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:22.324987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:22.325417 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:22.388969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:22.396840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1b4e0173-ec93-4f70-9de9-1a2853c490dc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1249 microversion: 2.1 time: 0.085456 Jul 15 17:49:22.397383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 149/293] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:22 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:22.646580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:22.647203 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:22.654096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:22.654552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:22.655328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:22.655788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:22.787495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:22.795554 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:22.798060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:22.799240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c325a563-334b-43eb-9eeb-8c5d71bac831 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1742 microversion: 2.20 time: 0.156844 Jul 15 17:49:22.799793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 145/294] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:22 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:23.413839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:23.414447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:23.421233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:23.421676 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:23.423066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:23.423621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:23.486000 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:23.494029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dbe1bafe-f2af-479e-85da-bf6c552d9277 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1249 microversion: 2.1 time: 0.083997 Jul 15 17:49:23.495288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 150/295] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:23 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:23.817917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:23.818534 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:23.824987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:23.825443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:23.826209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:23.826648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:23.964490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:23.968124 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:23.973255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:23.974935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:23.976155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-eb3fb3bc-5a50-4aa0-9306-8952f122bff7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1742 microversion: 2.20 time: 0.162143 Jul 15 17:49:23.976638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 146/296] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:23 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:24.511237 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:24.511836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:24.518880 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:24.519358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:24.520137 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:24.520567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:24.581969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:24.589928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3bd3d69c-3b5a-4b31-a812-45c37b99fb6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1249 microversion: 2.1 time: 0.082500 Jul 15 17:49:24.590497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 151/297] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:24 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:24.995202 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:24.995808 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:25.004094 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:25.004854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:25.005620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:25.006056 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:25.149798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:25.157756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:25.159294 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:25.160456 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d95fe1ae-d560-4870-b780-ad36a406ef9d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1742 microversion: 2.20 time: 0.169263 Jul 15 17:49:25.161058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 147/298] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:24 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:25.607314 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:25.607929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:25.614593 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:25.615033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:25.615787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:25.616219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:25.679942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:25.687541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a918b382-167c-4126-87e5-09b26d8f65dd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1241 microversion: 2.1 time: 0.084058 Jul 15 17:49:25.689668 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 152/299] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:25 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:25.847165 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-8c11735d-9610-4fc7-b29a-d576ee92c087 req-c74560ce-1b10-4199-b3a9-8ae9cfe2d171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "name": "network-vif-plugged", "status": "completed", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:25.868774 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-8c11735d-9610-4fc7-b29a-d576ee92c087 req-c74560ce-1b10-4199-b3a9-8ae9cfe2d171 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:25.869270 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-8c11735d-9610-4fc7-b29a-d576ee92c087 req-c74560ce-1b10-4199-b3a9-8ae9cfe2d171 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:25.880616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-8c11735d-9610-4fc7-b29a-d576ee92c087 req-c74560ce-1b10-4199-b3a9-8ae9cfe2d171 service nova] Creating event network-vif-plugged:9166a97f-a925-40c2-afe2-d0e85818ecf8 for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 on hv-cinder-83697 Jul 15 17:49:25.885785 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-8c11735d-9610-4fc7-b29a-d576ee92c087 req-c74560ce-1b10-4199-b3a9-8ae9cfe2d171 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043165 Jul 15 17:49:25.886411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 148/300] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:26.181797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:26.182406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:26.189089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:26.189542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:26.190309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:26.190748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:26.334513 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:26.352009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:26.359310 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:26.361394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cef6a6a6-b103-42e5-a07d-6132bdec28dd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1742 microversion: 2.20 time: 0.183506 Jul 15 17:49:26.362080 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 153/301] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:26 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:26.706023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:26.706721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:26.713996 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:26.714442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:26.715244 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:26.715677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:26.784031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:26.791772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-affdc80b-70e2-4788-acaf-6f120bbc1be1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1297 microversion: 2.1 time: 0.090779 Jul 15 17:49:26.792539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 149/302] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:26 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:27.380768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:27.381473 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:27.388155 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:27.388699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:27.389705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:27.390211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:27.617814 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:27.638273 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:27.640085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:27.642007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dad98fda-64df-4cc6-af31-82b57e81f413 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.265326 Jul 15 17:49:27.642858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 154/303] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:27 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:27.811410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:27.812026 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:27.829434 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:27.829434 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:27.829434 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:27.829434 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:28.198872 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b1153d9d-3031-4820-94b6-e27f8d2cf47e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: .version_select at 0x7f37d1692ca0>, body: {"keypair": {"name": "tempest-keypair-2114154958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlFBAZ2UQM8Qnzd9j8RzENBrxi00aO1iVg84i2s2isyLEEQFmDgQl2IWcSwm5soelcL1BqiS3cJJ82h4Plrya89g1U46LQXf84DLJ5ymnaVR0Sh2YHC+cgzoPV7fcHpyA=="}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:28.203908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:28.222629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-b1153d9d-3031-4820-94b6-e27f8d2cf47e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:49:28.228553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-b1153d9d-3031-4820-94b6-e27f8d2cf47e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:49:28.232012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0515446f-35c4-4bc5-b5f0-0d5117efcc4d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.424639 Jul 15 17:49:28.235351 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 150/304] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:27 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:28.382199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b1153d9d-3031-4820-94b6-e27f8d2cf47e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193961 Jul 15 17:49:28.382899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 155/305] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:49:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:28.663483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:28.665058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:28.678778 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:28.679514 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:28.681444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:28.683907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:29.124729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:29.135747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:29.143367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:29.147765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a670d125-eff9-4261-83ec-131653dc34a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.491534 Jul 15 17:49:29.159222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 151/306] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:28 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:29.264393 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:29.269875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:29.287668 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:29.293941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:29.293941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:29.293941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:29.480965 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:29.491897 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7a99c16d-c4bd-4cc6-91f4-bbcfc9e14fd4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.241228 Jul 15 17:49:29.492484 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 156/307] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:29 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:29.568954 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-f2e07203-f34c-47f7-8279-0fa023b028e7 req-eb0fd28e-af34-4bf7-8450-28c6ff0906b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:29.596639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-f2e07203-f34c-47f7-8279-0fa023b028e7 req-eb0fd28e-af34-4bf7-8450-28c6ff0906b2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:29.599791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-f2e07203-f34c-47f7-8279-0fa023b028e7 req-eb0fd28e-af34-4bf7-8450-28c6ff0906b2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:29.638222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-f2e07203-f34c-47f7-8279-0fa023b028e7 req-eb0fd28e-af34-4bf7-8450-28c6ff0906b2 service nova] Creating event network-changed:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:49:29.659510 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-f2e07203-f34c-47f7-8279-0fa023b028e7 req-eb0fd28e-af34-4bf7-8450-28c6ff0906b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097583 Jul 15 17:49:29.665843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 152/308] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:30.174285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:30.186370 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:30.193592 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:30.197566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:30.197566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:30.197566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:30.463624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:30.475929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:30.479190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:30.480853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a8f3afba-dfd0-4721-883a-837ec6ea6933 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.318627 Jul 15 17:49:30.482110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 157/309] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:30 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:30.511920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:30.513365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:30.521650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:30.522379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:30.523407 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:30.524132 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:30.799905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:30.815905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-32e19090-d653-4674-b90b-614226ce9f6d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.309230 Jul 15 17:49:30.825182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 153/310] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:30 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:31.499473 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:31.500088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:31.510405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:31.510405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:31.510405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:31.510405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:31.769159 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:31.777212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:31.778717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:31.779873 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-65ca0207-8a23-4697-ab26-df989105e3b9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.284451 Jul 15 17:49:31.780429 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 158/311] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:31 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:31.845024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:31.846558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=10 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:31.851125 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:31.851739 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:31.857796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:31.858250 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:31.859009 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:31.860061 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:32.012978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:32.020423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-21226aab-eeec-40d8-b9c2-435ee779b618 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.176867 Jul 15 17:49:32.020973 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 154/312] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:31 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:32.612136 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1330565468", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9128f0d2-178e-413a-a0d2-d7efa1403a9e"}], "security_groups": [{"name": "tempest-securitygroup--1615221574"}], "key_name": "tempest-keypair-2114154958", "user_data": "}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:32.726452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] validate_networks() for [('9128f0d2-178e-413a-a0d2-d7efa1403a9e', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:49:32.799418 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:32.801286 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:32.807580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:32.808035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:32.808848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:32.809528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:33.023625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:33.028763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:33.030905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:33.032735 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0593fbba-762c-49c8-8611-609739bad43c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.237976 Jul 15 17:49:33.033708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 155/313] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:32 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:33.039388 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:33.040268 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:33.048751 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:33.049591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:33.050612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:33.051275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:33.228038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:33.237288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ef3bc0e9-31aa-4c0d-a571-b727ed162348 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.202259 Jul 15 17:49:33.237863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 156/314] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:33 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:33.281067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:49:33.281496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:49:33.288514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:49:33.288977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:49:33.289396 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:49:33.308199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:33.308199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:33.308199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:33.308199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:33.332779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:49:33.337888 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:49:33.352756 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:49:33.355613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:49:33.525016 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-159d26c2-b7a2-42dd-b937-da49f54c9519 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.916624 Jul 15 17:49:33.527567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 159/315] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:49:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:49:33.537074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-04a28daf-01fa-4fab-8e88-755ce006ca7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:33.537821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-04a28daf-01fa-4fab-8e88-755ce006ca7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:33.631920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-04a28daf-01fa-4fab-8e88-755ce006ca7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:33.639346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-04a28daf-01fa-4fab-8e88-755ce006ca7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1242 microversion: 2.1 time: 0.107001 Jul 15 17:49:33.639919 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 157/316] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:33 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:34.055199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:34.061351 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:34.067555 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:34.068323 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:34.070025 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:34.070677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:34.102648 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:34.260029 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:34.266727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:34.289960 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:34.290755 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:34.292952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:34.294161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:34.317784 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:34.333985 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:34.337152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:34.341692 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-617acbf1-44ce-475f-a471-2fa5877e6025 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.293673 Jul 15 17:49:34.344064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 160/317] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:34 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:34.485661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:34.496694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1165b232-f52a-43bc-b9bd-7973c2dc246a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.245203 Jul 15 17:49:34.503570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 158/318] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:34 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:34.658509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cc4ebaf1-f133-406d-9c03-a3aa19760c99 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:34.659137 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cc4ebaf1-f133-406d-9c03-a3aa19760c99 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:34.703165 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f98b70e4-5d8a-4974-92c1-b54237bef2fb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:34.711026 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f98b70e4-5d8a-4974-92c1-b54237bef2fb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:34.711807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f98b70e4-5d8a-4974-92c1-b54237bef2fb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:34.748987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cc4ebaf1-f133-406d-9c03-a3aa19760c99 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:34.760677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cc4ebaf1-f133-406d-9c03-a3aa19760c99 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1242 microversion: 2.1 time: 0.107313 Jul 15 17:49:34.771697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 161/319] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:34 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:34.793747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f98b70e4-5d8a-4974-92c1-b54237bef2fb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Going to try to stop instance {{(pid=124745) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 17:49:35.189499 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f98b70e4-5d8a-4974-92c1-b54237bef2fb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action" status: 202 len: 0 microversion: 2.1 time: 0.494538 Jul 15 17:49:35.199327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:35.200567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:35.204369 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 159/320] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:49:34 2022] POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:49:35.209127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.209876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.210968 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.211545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.364816 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:35.367017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:35.375161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.375994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.378114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.379418 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.412231 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:35.426932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a916c891-2001-4ac1-99ea-aa78f96c6f94 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.231976 Jul 15 17:49:35.428064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 162/321] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:35 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:35.531987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:35.533113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:35.555842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.555842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.558296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.558974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.572432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:35.589405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:35.590917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:35.601310 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b08ada82-55cb-41a2-a66e-be806295de7e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.236515 Jul 15 17:49:35.611077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 160/322] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:35 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:35.785017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:35.785017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:35.808067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.808067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.808067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:35.808067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:35.871075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:35.910612 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-546bfa54-f278-477d-8a6a-7b1c977f6913 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.383227 Jul 15 17:49:35.911773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 163/323] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:35 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:35.944617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:35.954680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f653c676-25a1-43f5-bcc3-22edc9ae1ef1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1294 microversion: 2.1 time: 0.177493 Jul 15 17:49:35.965100 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 161/324] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:35 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1294 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:36.460908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:36.461493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:36.467830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:36.468271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:36.469838 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:36.470276 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:36.601782 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:36.611265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-840aa076-d9ea-41cd-857a-4eb17033b730 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.154132 Jul 15 17:49:36.612209 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 164/325] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:36 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:36.628468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:36.630138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:36.637003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:36.637458 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:36.638238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:36.638692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:36.841323 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:36.852040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:36.854597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:36.855422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f87081dc-97a8-4f1f-ad05-39848032056d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.232132 Jul 15 17:49:36.856280 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 162/326] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:36 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:36.933298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:36.934162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:36.944422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:36.949568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:36.950536 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:36.951214 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:36.973173 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:36.973720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:37.005879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:37.006332 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:37.007130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:37.007559 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:37.202920 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:37.212910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e0c82620-90bd-445b-bf49-2e3572917a55 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.283900 Jul 15 17:49:37.214303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 165/327] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:36 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:37.412629 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:37.430745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1d119283-36df-4d3d-b85c-61d95d14d770 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1294 microversion: 2.1 time: 0.460939 Jul 15 17:49:37.442773 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 163/328] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:36 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1294 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:37.632162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:37.632848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:37.653904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:37.654360 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:37.655148 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:37.657212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:37.874835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:37.876541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:37.889918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:37.890252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:37.892221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:37.894476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:37.970306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:37.982742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-81081880-e85a-4942-9d98-41a93e116fd8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.357988 Jul 15 17:49:37.986267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 166/329] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:37 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:38.239600 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:38.242140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:38.251166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:38.259480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:38.276629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:38.277734 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:38.281882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:38.289659 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:38.289932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:38.295868 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:38.302451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d7cadf4d-f7b6-4e3e-bb3e-cba19e5feb77 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.427859 Jul 15 17:49:38.305692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 164/330] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:37 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:38.449829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:38.450689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:38.467978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:38.468716 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:38.470344 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:38.473472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:38.673376 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:38.684836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:38.685708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-faa1a2c3-6f29-4d9d-8065-1f8421c59c17 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1300 microversion: 2.1 time: 0.241940 Jul 15 17:49:38.688587 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 165/331] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:38 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1300 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:38.695430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-3e258939-508e-42a2-8949-6fe38f2e05f1 req-ab9ec79a-bfbc-4088-8d1e-fe09a6f614d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "name": "network-vif-plugged", "status": "completed", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:38.706635 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-3e258939-508e-42a2-8949-6fe38f2e05f1 req-ab9ec79a-bfbc-4088-8d1e-fe09a6f614d7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:38.707138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-3e258939-508e-42a2-8949-6fe38f2e05f1 req-ab9ec79a-bfbc-4088-8d1e-fe09a6f614d7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:38.711986 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-03b4faf5-c7e4-4a45-9940-30f9bc5b7a7c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.483100 Jul 15 17:49:38.716797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 167/332] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:38 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:38.746392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-3e258939-508e-42a2-8949-6fe38f2e05f1 req-ab9ec79a-bfbc-4088-8d1e-fe09a6f614d7 service nova] Creating event network-vif-plugged:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:49:38.747256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-3e258939-508e-42a2-8949-6fe38f2e05f1 req-ab9ec79a-bfbc-4088-8d1e-fe09a6f614d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057162 Jul 15 17:49:38.748087 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 166/333] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:39.003728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:39.004976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:39.041726 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.043524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.048075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.052539 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.324708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:39.326023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:39.329336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:39.343734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.344189 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.347717 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.348179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.404688 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:39.422894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d1412785-61a4-42d6-9d9b-53fd41c1c639 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.423594 Jul 15 17:49:39.431644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 168/334] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:38 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:39.704558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:39.708291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:39.713433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.715259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.716167 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.716945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.752317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:39.769181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:39.770696 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:39.773481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f3dd4dbe-79f7-459b-a395-f2111de0a313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.453122 Jul 15 17:49:39.785509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 167/335] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:39 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:39.791550 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:39.792410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:39.800681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.802207 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:39.803309 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:39.805085 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:40.052060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:40.061727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-85710780-e02e-48d9-b037-0c758feaec95 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.274778 Jul 15 17:49:40.065362 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 168/336] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:39 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:40.400623 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:40.416549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-05ca7c25-ea6b-437f-9927-ef8ceaaf96cb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.715115 Jul 15 17:49:40.418168 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 169/337] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:39 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:40.456893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:40.461766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:40.485221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:40.485962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:40.487157 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:40.487847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:40.794245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:40.794884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:40.802350 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:40.822852 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b54b5e82-5b46-42c2-a84e-2fd972493028 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.367400 Jul 15 17:49:40.840257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 169/338] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:40 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:40.840956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:40.840956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:40.840956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:40.840956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.082200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:41.083329 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:41.098954 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.102826 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.105314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.113050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.150306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:41.164562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:41.188542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:41.193752 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7cd22e6d-3ead-40c1-bb1a-50feeb8978e0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.405727 Jul 15 17:49:41.211114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 170/339] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:40 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:41.275568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-066f9351-5246-4a71-a0df-877896dbcd59 req-010eda2e-888a-4bda-b12e-119fdb54a5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36cd5a6a-1e60-47ed-8ccd-a19e52410f79", "tag": "12027af2-ea3d-40e3-883b-ba21676944b9"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:41.300898 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-066f9351-5246-4a71-a0df-877896dbcd59 req-010eda2e-888a-4bda-b12e-119fdb54a5d9 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.302340 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-066f9351-5246-4a71-a0df-877896dbcd59 req-010eda2e-888a-4bda-b12e-119fdb54a5d9 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.340044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-066f9351-5246-4a71-a0df-877896dbcd59 req-010eda2e-888a-4bda-b12e-119fdb54a5d9 service nova] Creating event network-changed:12027af2-ea3d-40e3-883b-ba21676944b9 for instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 on hv-cinder-83697 Jul 15 17:49:41.350665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-066f9351-5246-4a71-a0df-877896dbcd59 req-010eda2e-888a-4bda-b12e-119fdb54a5d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085220 Jul 15 17:49:41.354311 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 171/340] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:49:41.452858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:41.452858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:41.457929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.458686 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.460013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.460466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.605876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:41.615926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a4730084-5abf-4af2-80f4-0dc90569d471 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1371 microversion: 2.1 time: 0.538011 Jul 15 17:49:41.623357 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 170/341] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:41 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:41.843294 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:41.856898 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:41.857843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:41.859117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c0f48df9-fc3f-4829-bdf2-105dcb3a4f24 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.425802 Jul 15 17:49:41.862154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 172/342] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:41 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:41.867211 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.867749 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:41.868690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:41.869206 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.059297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:42.067272 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-48aca0ed-a6d0-4565-b25c-51b8bb79fac5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.218345 Jul 15 17:49:42.067833 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 171/343] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:41 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:42.215403 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:42.216018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:42.222337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.222791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.226571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.226571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.394153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:42.408910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:42.411747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:42.415705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f1e6a360-ab9f-4732-a819-6b7264d03137 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.203093 Jul 15 17:49:42.428316 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 173/344] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:42 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:42.634378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:42.634984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:42.651072 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.655324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.655324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.655324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.855624 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:42.866286 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-dd231f1c-d511-455c-9a4f-920023674e56 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1566 microversion: 2.1 time: 0.236113 Jul 15 17:49:42.868014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 172/345] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:42 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:42.881365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:42.887585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:42.887585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:42.891470 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.892194 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.893118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.894387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.902613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:42.903120 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:42.920187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.921916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:42.923025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:42.923634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:43.049256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-12f04844-3549-44a6-a4e1-000f9d17bb13 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161589 Jul 15 17:49:43.053765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 173/346] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:49:42 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:43.087805 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:43.088424 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:43.107167 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:43.111192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:43.111192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:43.111192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:43.151686 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:43.167413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-22680a97-80a2-46fd-8ef3-042aff363e04 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.291121 Jul 15 17:49:43.168746 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 174/347] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:42 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:43.438190 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:43.439531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:43.440883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:43.444342 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:43.453108 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1d7d80b6-2cc1-4bdb-8847-f97349e69906 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.369539 Jul 15 17:49:43.453817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 174/348] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:43 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:43.459543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:43.459992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:43.460812 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:43.461244 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:43.632924 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:43.669873 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:43.674667 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:43.679998 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-819ead9d-1cdf-430d-8c9c-a6f921365720 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1737 microversion: 2.20 time: 0.245649 Jul 15 17:49:43.681521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 175/349] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:43 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:44.188926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:44.189642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:44.194824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:44.202735 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.204295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.205309 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.205898 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.470615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:44.471916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:44.479017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:44.485038 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.492506 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.495746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6497ccf0-9295-4100-be81-56f0cabb17d2 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.312913 Jul 15 17:49:44.496558 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.497207 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 175/350] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:44 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:44.506545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.678946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:44.687290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3e7e3022-4adb-4d21-bcf9-a16df773f679 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.221340 Jul 15 17:49:44.690397 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 176/351] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:44 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:44.700580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:44.701558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:44.708499 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.719561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.719561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.719561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.878775 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-2c47911b-d956-4cb5-8963-dba4cd333162 req-9641f001-73ac-41fb-a031-09e569d515b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:44.883271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=14 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:44.889710 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-2c47911b-d956-4cb5-8963-dba4cd333162 req-9641f001-73ac-41fb-a031-09e569d515b2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:44.890677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-2c47911b-d956-4cb5-8963-dba4cd333162 req-9641f001-73ac-41fb-a031-09e569d515b2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:44.904869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-2c47911b-d956-4cb5-8963-dba4cd333162 req-9641f001-73ac-41fb-a031-09e569d515b2 service nova] Creating event network-changed:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:49:44.913138 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-2c47911b-d956-4cb5-8963-dba4cd333162 req-9641f001-73ac-41fb-a031-09e569d515b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037601 Jul 15 17:49:44.915220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 177/352] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:49:45.030505 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:45.045134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:45.047160 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:45.048532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-06d24fe2-d50a-4f28-b35b-7d139d03ea25 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1719 microversion: 2.20 time: 0.353898 Jul 15 17:49:45.049570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 176/353] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:44 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1719 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:45.514246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:45.515000 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:45.524067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:45.524511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:45.525336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:45.525764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:45.694099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:45.704956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:45.711646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:45.711796 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-11a4523d-4199-4de7-9db3-8b7d777f2e8d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.195589 Jul 15 17:49:45.713770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:45.714036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 178/354] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:45 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:45.714609 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:45.715581 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:45.716935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:45.990507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:46.000198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-751f3534-5874-41e7-a6fa-752ece026451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.298799 Jul 15 17:49:46.001109 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 177/355] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:45 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:46.068001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:46.068999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:46.091681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:46.092541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:46.093852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:46.094603 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:46.161870 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:46.224340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-496702049", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "networks": [{"uuid": "cd2bfcbe-c0b6-4b17-ba6f-cc35996f1c8e"}]}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:46.301366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] validate_networks() for [('cd2bfcbe-c0b6-4b17-ba6f-cc35996f1c8e', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:49:46.363721 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:46.376912 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:46.380860 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:46.391319 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-72b5ddb0-ef73-408b-96a3-687898ec0252 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1719 microversion: 2.20 time: 0.321027 Jul 15 17:49:46.392270 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 179/356] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:46 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1719 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:46.723731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:46.724437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:46.731685 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:46.732215 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:46.733095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:46.733531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:46.932683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:46.941535 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-54f95904-7a81-4675-93c6-935d73dea682 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.221539 Jul 15 17:49:46.942122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 180/357] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:46 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:46.990697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:49:46.991178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:49:46.991577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:49:46.992130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:49:46.992787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:49:47.003055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.003503 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.004554 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.005017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.018750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:47.019361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:47.026742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.028768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.032282 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Getting quotas for project d6aa269b9af048c1860128aa8db2bf28. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:49:47.032451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.034508 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.036523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Getting quotas for user 611f51a2f6434e0ab78559d8b03493df and project d6aa269b9af048c1860128aa8db2bf28. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:49:47.049114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:49:47.051922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:49:47.154547 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ad9c8239-ebf6-42f1-b95c-c7f85e4b1f98 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934630 Jul 15 17:49:47.155635 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 178/358] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:49:47.178861 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fc31ccc9-dcfc-4e37-a130-8ab437958117 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:47.180109 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fc31ccc9-dcfc-4e37-a130-8ab437958117 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:47.201871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:47.211017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-093d0542-887a-48c8-92bd-9ca20be3378b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.196515 Jul 15 17:49:47.211895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 181/359] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:47 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:47.252338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fc31ccc9-dcfc-4e37-a130-8ab437958117 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:47.267419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fc31ccc9-dcfc-4e37-a130-8ab437958117 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1218 microversion: 2.1 time: 0.104777 Jul 15 17:49:47.269121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 179/360] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:47 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:47.409524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:47.410151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:47.416171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.416530 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.417329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.417760 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.551008 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:47.559710 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:47.560858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:47.562544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f64ff85d-589c-4a5f-9a16-90f287a0146f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1719 microversion: 2.20 time: 0.156399 Jul 15 17:49:47.563103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 182/361] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:47 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:47.959345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:47.959965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:47.968342 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.969341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:47.969800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:47.970241 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.138617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:48.149019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f01ee725-60c7-4550-99b2-d5ae1c606c27 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.193578 Jul 15 17:49:48.149553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 180/362] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:47 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:48.228366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:48.229164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:48.236734 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.237188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.238002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.238444 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.288300 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-55d481db-a569-40af-b03f-2d38309d7efc tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:48.290477 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-55d481db-a569-40af-b03f-2d38309d7efc tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:48.367535 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-55d481db-a569-40af-b03f-2d38309d7efc tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:48.374399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-55d481db-a569-40af-b03f-2d38309d7efc tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1218 microversion: 2.1 time: 0.093150 Jul 15 17:49:48.386210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 181/363] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:48 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:48.417202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:48.426690 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-221dea1c-e617-49d4-af67-a7cea233fa11 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.202205 Jul 15 17:49:48.427457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 183/364] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:48 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:48.464330 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-29d0fa37-7cff-4262-a3cc-0de6892b870b req-3749c98a-789f-4d08-a263-a52cd1f243f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36cd5a6a-1e60-47ed-8ccd-a19e52410f79", "name": "network-vif-plugged", "status": "completed", "tag": "12027af2-ea3d-40e3-883b-ba21676944b9"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:48.473004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-29d0fa37-7cff-4262-a3cc-0de6892b870b req-3749c98a-789f-4d08-a263-a52cd1f243f1 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.473531 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-29d0fa37-7cff-4262-a3cc-0de6892b870b req-3749c98a-789f-4d08-a263-a52cd1f243f1 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.486792 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-29d0fa37-7cff-4262-a3cc-0de6892b870b req-3749c98a-789f-4d08-a263-a52cd1f243f1 service nova] Creating event network-vif-plugged:12027af2-ea3d-40e3-883b-ba21676944b9 for instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 on hv-cinder-83697 Jul 15 17:49:48.491936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-29d0fa37-7cff-4262-a3cc-0de6892b870b req-3749c98a-789f-4d08-a263-a52cd1f243f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039900 Jul 15 17:49:48.492657 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 182/365] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:48.582801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:48.583302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:48.589339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.589829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.590886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.591323 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.750920 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:48.762180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:48.764284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:48.769829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e6924e8a-cab8-4c93-86c2-23bb1db248d0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1722 microversion: 2.20 time: 0.189690 Jul 15 17:49:48.769829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 184/366] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:48 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:48.785234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fecff29-4b2e-4db8-a34e-f7992923e604"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:48.786623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:48.793338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.793788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:48.794565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:48.795181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.167071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:49.167757 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:49.173767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:49.174203 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.175039 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:49.175481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.339739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:49.347800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-556c5ff8-e6fd-498f-aa41-687b4be0f764 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.184512 Jul 15 17:49:49.348354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 185/367] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:49 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:49.394441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:49.395202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:49.405600 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:49.406775 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.407676 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:49.408123 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.479747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:49.487678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a211b7ee-56a7-47eb-b91d-1f5db38f775a tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1214 microversion: 2.1 time: 0.098085 Jul 15 17:49:49.488267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 186/368] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:49 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:49.493116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:49.493715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:49.500018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:49.500528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.501329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:49.501760 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:49.636541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:49.644645 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-04b14a6b-40ea-4828-aedf-bbd97c86629b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.155207 Jul 15 17:49:49.645201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 187/369] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:49 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:50.245948 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:50.295721 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-686684011", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:50.346356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] validate_networks() for None {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:49:50.362402 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b4bdf47e-a089-4724-a102-2d14337b06c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.582083 Jul 15 17:49:50.368084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 183/370] 10.222.0.57 () {62 vars in 1363 bytes} [Fri Jul 15 17:49:48 2022] POST /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments => generated 188 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:49:50.368084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:50.368621 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:50.380014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.382419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.383436 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.391103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.569628 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:50.579064 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3f30f4bb-4cc9-4ef6-b77a-14b74dc3ea80 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1368 microversion: 2.1 time: 0.214647 Jul 15 17:49:50.588943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 184/371] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:50 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:50.595068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:50.595748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:50.608095 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.609860 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.611097 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.611555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.677835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:50.685340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-92fff810-bcac-4a5f-8b89-e89b3de201a9 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1270 microversion: 2.1 time: 0.094855 Jul 15 17:49:50.686868 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:49:50.687725 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 185/372] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:50 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:50.687821 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:49:50.688321 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:49:50.688996 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:49:50.689420 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:49:50.691681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-7cbc6b37-8803-4e44-936e-16dc5647bfcf req-b69b5b73-e6b5-43e3-9f2a-823f09e73ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "name": "network-vif-unplugged", "status": "completed", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:50.698845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.699293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.699674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-7cbc6b37-8803-4e44-936e-16dc5647bfcf req-b69b5b73-e6b5-43e3-9f2a-823f09e73ab7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.700116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.700225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-7cbc6b37-8803-4e44-936e-16dc5647bfcf req-b69b5b73-e6b5-43e3-9f2a-823f09e73ab7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.700555 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.711500 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.compute.server_external_events [req-7cbc6b37-8803-4e44-936e-16dc5647bfcf req-b69b5b73-e6b5-43e3-9f2a-823f09e73ab7 service nova] Unable to find a host for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9. Dropping event network-vif-unplugged {{(pid=124745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 15 17:49:50.712278 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-7cbc6b37-8803-4e44-936e-16dc5647bfcf req-b69b5b73-e6b5-43e3-9f2a-823f09e73ab7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025061 Jul 15 17:49:50.712905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 186/373] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 15 17:49:50.717518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:50.717919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Getting quotas for project 4c78e372e4d147469bc31a44717a1807. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:49:50.718073 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:50.722270 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Getting quotas for user 0e392abb964c48d1945b50d0f1888137 and project 4c78e372e4d147469bc31a44717a1807. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:49:50.724906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.725353 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.726297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.726733 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.734569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:49:50.737262 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:49:50.895895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e7bca66c-a329-4b3a-ae4b-47cf2da77654 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603940 Jul 15 17:49:50.896547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 188/374] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 17:49:50.901278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:50.902579 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:50.912476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.913117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:50.914010 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:50.914559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.036118 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5dcb1d12-0c7f-4fec-88af-3899121c419d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/action" status: 202 len: 0 microversion: 2.20 time: 0.322182 Jul 15 17:49:51.037033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 187/375] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 15 17:49:50 2022] POST /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:49:51.042088 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0f5c857f-5e61-4914-8846-4026b072f473 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:51.042978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0f5c857f-5e61-4914-8846-4026b072f473 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:51.075535 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.088643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ec509c5d-9fc9-4aa8-aa9c-537a2f4750a4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1721 microversion: 2.1 time: 0.191013 Jul 15 17:49:51.090145 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 189/376] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:50 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:51.096037 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:51.096924 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:51.104134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.104902 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.105871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.106565 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.133761 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0f5c857f-5e61-4914-8846-4026b072f473 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.141608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0f5c857f-5e61-4914-8846-4026b072f473 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1214 microversion: 2.1 time: 0.103383 Jul 15 17:49:51.155377 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 188/377] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:51 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:51.300654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.316909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.318540 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.319800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-33bec4f6-7f5a-4ac2-823a-1b8ed93a9f33 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1748 microversion: 2.20 time: 0.228539 Jul 15 17:49:51.331483 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 190/378] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:51 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1748 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:51.596688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:51.597745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:51.609371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.609823 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.613953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.613953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.702991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:51.704034 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:51.710291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.710741 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.711510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.711940 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.785256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.793615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-43c8fe61-a040-4e20-a5fa-24b5398b7b88 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1276 microversion: 2.1 time: 0.094653 Jul 15 17:49:51.794178 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 191/379] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:51 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:51.853634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:51.862059 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d6ff219d-85b0-4f86-92db-82ad3043cfa9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1558 microversion: 2.1 time: 0.270216 Jul 15 17:49:51.862639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 189/380] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:51 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1558 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:51.887002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:51.887565 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:51.896026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.896350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:51.897257 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:51.897813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.050184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-86836ad0-0ef1-4256-af28-cddbfded5387 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167199 Jul 15 17:49:52.050777 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 192/381] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:49:51 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:52.111154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:52.112147 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:52.130848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.131849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.133756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.134416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.159958 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b3760181-5932-41bc-9dd7-500e913d0689 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:52.161117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b3760181-5932-41bc-9dd7-500e913d0689 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:52.283926 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b3760181-5932-41bc-9dd7-500e913d0689 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:52.292038 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b3760181-5932-41bc-9dd7-500e913d0689 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1214 microversion: 2.1 time: 0.137783 Jul 15 17:49:52.292833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 193/382] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:52 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:52.339789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:52.340764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:52.360085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.360819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.361759 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.362339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.453084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:52.461198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7a1db646-b0a2-44e2-8bb7-5ca48c223698 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1698 microversion: 2.1 time: 0.357644 Jul 15 17:49:52.473634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 190/383] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:52 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1698 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:52.479234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-03f5fea5-0565-4541-9bf4-61e96f2e0792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:52.487712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-03f5fea5-0565-4541-9bf4-61e96f2e0792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.488490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-03f5fea5-0565-4541-9bf4-61e96f2e0792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.519519 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-03f5fea5-0565-4541-9bf4-61e96f2e0792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Going to try to start instance {{(pid=124745) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 17:49:52.665457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:52.680517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:52.682304 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:52.684120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ee0633e8-6f6f-45c6-918e-189d6e595e2f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1748 microversion: 2.20 time: 0.349613 Jul 15 17:49:52.686031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 194/384] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:52 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1748 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:52.813058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:52.814771 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:52.823732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.824193 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.825023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.825458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.840314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-03f5fea5-0565-4541-9bf4-61e96f2e0792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action" status: 202 len: 0 microversion: 2.1 time: 0.364594 Jul 15 17:49:52.841555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 191/385] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:49:52 2022] POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:49:52.851714 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:52.853763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:52.861862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.862344 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:52.863297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:52.863844 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:53.069540 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:53.079491 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fd5f58ba-ca38-4686-9cb5-56a8548a4d7e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.271061 Jul 15 17:49:53.081284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 195/386] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:52 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:53.142469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:53.152096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-448688d4-994e-4a98-99ad-a0e2a439a939 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1707 microversion: 2.1 time: 0.304976 Jul 15 17:49:53.154103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 192/387] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:52 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1707 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:53.313931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:53.314792 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:53.323036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:53.324392 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:53.326259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:53.326901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:53.406925 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:53.414445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8359a596-5410-493b-b036-d7bb6122be7b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1266 microversion: 2.1 time: 0.106505 Jul 15 17:49:53.415011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 196/388] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:53 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:53.486033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-67354cec-d860-46f0-a509-573eb90f7999 req-21ed7846-2757-475e-a2a6-cde0f0ad8009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda2df16-ace1-4f74-a2a1-a14156d5eec4", "tag": "ee87a707-2c23-4c29-be4e-ac7a5113509d"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:53.495326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-67354cec-d860-46f0-a509-573eb90f7999 req-21ed7846-2757-475e-a2a6-cde0f0ad8009 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:53.496089 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-67354cec-d860-46f0-a509-573eb90f7999 req-21ed7846-2757-475e-a2a6-cde0f0ad8009 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:53.503959 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-1c96f24f-04c2-465a-8f3d-69fc79a570ec req-84381f2d-7c0e-4010-9225-a89dce13b964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36cd5a6a-1e60-47ed-8ccd-a19e52410f79", "tag": "12027af2-ea3d-40e3-883b-ba21676944b9"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:53.509467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-67354cec-d860-46f0-a509-573eb90f7999 req-21ed7846-2757-475e-a2a6-cde0f0ad8009 service nova] Creating event network-changed:ee87a707-2c23-4c29-be4e-ac7a5113509d for instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 on hv-cinder-83697 Jul 15 17:49:53.513698 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-1c96f24f-04c2-465a-8f3d-69fc79a570ec req-84381f2d-7c0e-4010-9225-a89dce13b964 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:53.523427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-1c96f24f-04c2-465a-8f3d-69fc79a570ec req-84381f2d-7c0e-4010-9225-a89dce13b964 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:53.524021 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-67354cec-d860-46f0-a509-573eb90f7999 req-21ed7846-2757-475e-a2a6-cde0f0ad8009 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032959 Jul 15 17:49:53.524021 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 193/389] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:53.528932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-1c96f24f-04c2-465a-8f3d-69fc79a570ec req-84381f2d-7c0e-4010-9225-a89dce13b964 service nova] Creating event network-changed:12027af2-ea3d-40e3-883b-ba21676944b9 for instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 on hv-cinder-83697 Jul 15 17:49:53.534877 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-1c96f24f-04c2-465a-8f3d-69fc79a570ec req-84381f2d-7c0e-4010-9225-a89dce13b964 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036272 Jul 15 17:49:53.535548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 197/390] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:49:53.707006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:53.708038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:53.717057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:53.717864 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:53.720913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:53.722530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.097375 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:54.098942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:54.105656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:54.107164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.108177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:54.109040 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.329627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:54.333895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:54.339718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f32ef708-927d-4500-9376-443e5fe0b764 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.246164 Jul 15 17:49:54.340524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 198/391] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:54 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:54.347120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:54.347973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:54.348784 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:54.357862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:54.358322 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.359173 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:54.359671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.359780 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:54.369605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:54.370865 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b94a5ab2-5b20-4e38-948d-196e74ff23e9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1750 microversion: 2.20 time: 0.670546 Jul 15 17:49:54.372168 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 194/392] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:53 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1750 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:49:54.432209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:54.439100 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:54.440977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:54.441432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.442247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:54.442681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:54.555434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:54.568242 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9e48b726-136c-4cd2-a4f7-28aaa3cb2fa8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1707 microversion: 2.1 time: 0.226402 Jul 15 17:49:54.569742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 199/393] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:54 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1707 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:54.756958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:54.765113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7437b800-93a6-490c-b8b5-61888be08c09 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1272 microversion: 2.1 time: 0.337408 Jul 15 17:49:54.766105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 195/394] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:54 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:55.360589 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:55.361226 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:55.368090 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.368541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.369362 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.369803 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.391379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:55.391997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:55.398576 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.399025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.399926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.400414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.526791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:55.536812 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d747a1e4-08e2-4278-ae1f-9c595182b685 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.180625 Jul 15 17:49:55.537393 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 200/395] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:55 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:55.588366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:55.589063 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:55.597585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.598394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.599359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.599799 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.645865 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:55.657845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:55.659384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:55.660582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-62a5365f-ecb6-4cc0-a8fa-8c9da5c39c4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.274945 Jul 15 17:49:55.661352 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 196/396] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:55 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:55.761518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:55.771602 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3928221b-83a3-4c07-8f50-0fd2b07ba8a8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1707 microversion: 2.1 time: 0.188242 Jul 15 17:49:55.772940 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 201/397] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:55 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1707 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:55.789360 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:55.789979 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:55.796638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.797078 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.797857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:55.798292 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:55.876330 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:55.884040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-aa567154-3cc3-4fba-9191-19f5d23b1efa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1272 microversion: 2.1 time: 0.099926 Jul 15 17:49:55.884625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 197/398] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:55 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:56.558001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:56.558622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:56.566728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.568089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.569073 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.569681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.685530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:56.686142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:56.700661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.701311 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.702081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.706183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.714991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:56.723018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-95e096af-2c01-4e7c-be95-0ac14e89ef17 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.169081 Jul 15 17:49:56.723582 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 202/399] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:56 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:56.795912 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:56.797254 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:56.803278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.803717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.804476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.804934 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.941200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:56.951558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:56.952675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:56.953176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:56.955037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ee2cde35-9381-429f-af45-7d4c303258d9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.275733 Jul 15 17:49:56.956549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 198/400] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:56 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:56.962766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:56.963555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:56.970267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.970711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:56.971124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-058bd630-2acf-4900-9b08-52f5306d59e8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1711 microversion: 2.1 time: 0.179033 Jul 15 17:49:56.971513 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:56.972267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 203/401] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:56 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1711 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:49:56.975564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:57.014202 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:57.120524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:57.128540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ae43e86c-3ccc-4998-83a2-aff1b3a1d2a8 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.170863 Jul 15 17:49:57.129537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 199/402] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:56 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:57.510671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-40906bc4-31ac-4f48-aeec-e618e48c9fb3 req-fab989e0-cd3e-461a-8039-015bec645f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba512d4-5596-4492-9658-a5e049dc0e46", "tag": "a25babfc-cc3c-4368-bdb2-95a6ee1ffc1a"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:49:57.522223 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-40906bc4-31ac-4f48-aeec-e618e48c9fb3 req-fab989e0-cd3e-461a-8039-015bec645f8f service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:57.522776 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-40906bc4-31ac-4f48-aeec-e618e48c9fb3 req-fab989e0-cd3e-461a-8039-015bec645f8f service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:57.537695 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-40906bc4-31ac-4f48-aeec-e618e48c9fb3 req-fab989e0-cd3e-461a-8039-015bec645f8f service nova] Creating event network-changed:a25babfc-cc3c-4368-bdb2-95a6ee1ffc1a for instance dba512d4-5596-4492-9658-a5e049dc0e46 on hv-cinder-83697 Jul 15 17:49:57.544552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-40906bc4-31ac-4f48-aeec-e618e48c9fb3 req-fab989e0-cd3e-461a-8039-015bec645f8f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041528 Jul 15 17:49:57.545345 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 204/403] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:49:57.744970 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:57.745590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:57.752971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:57.753423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:57.754464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:57.754906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:57.759344 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:57.974928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:57.975603 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:57.982281 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:57.982728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:57.983495 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:57.984706 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:58.017454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:58.028705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b0c4e15c-6ac2-43d7-9000-b01ebb6adab2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.288010 Jul 15 17:49:58.029290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 200/404] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:57 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:58.121283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:58.136682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:58.136682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:58.136682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1497f214-b423-4a9c-abdf-a3049df7951d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.164937 Jul 15 17:49:58.146988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 205/405] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:57 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:58.148932 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:58.149366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:58.156588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:58.157071 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:58.157856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:58.158294 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:58.495680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:58.504941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4eb097f7-a1a5-4d66-91bc-f9bc0290f0b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.362380 Jul 15 17:49:58.505520 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 201/406] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:58 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:59.045577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:59.046876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:59.053391 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:59.053834 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:59.054596 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:59.055041 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:59.153698 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:59.154309 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:59.161311 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:59.161765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:59.162544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:59.162983 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:59.191551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:59.199424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-10a9027a-c22a-4a72-9446-1c62574f60a7 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.157643 Jul 15 17:49:59.200052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 206/407] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:59 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:49:59.297576 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:59.305905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:59.307412 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:59.308561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-28e84afc-6d4b-46ff-a8e4-44dab0b15646 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.158952 Jul 15 17:49:59.309335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 202/408] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:49:59 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:49:59.522113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:49:59.522642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:49:59.528842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:59.529298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:59.530073 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:49:59.531011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:49:59.661534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:49:59.669048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3552fa77-6fe7-4bac-8f6d-3ae177c13f4a tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.151006 Jul 15 17:49:59.670067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 207/409] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:49:59 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:00.216926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:00.217543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:00.225356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.225984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.226941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.227516 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.326913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:00.327553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:00.336613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.340960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.340960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.340960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.431128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:00.441740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-19ae40c7-5191-4a73-8710-6c362316780c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.229164 Jul 15 17:50:00.442780 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 203/410] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:00 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:00.542950 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:00.553166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:00.555155 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:00.556633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a57a11e0-dac0-4f77-bed4-69abef24583a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.233932 Jul 15 17:50:00.557384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 208/411] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:00 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:00.571585 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-c55ff519-aa11-4c53-99df-4b95ae0eb340 req-3d078349-0cf5-4dc5-b299-baeeee06a803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda2df16-ace1-4f74-a2a1-a14156d5eec4", "name": "network-vif-plugged", "status": "completed", "tag": "ee87a707-2c23-4c29-be4e-ac7a5113509d"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:00.582613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-c55ff519-aa11-4c53-99df-4b95ae0eb340 req-3d078349-0cf5-4dc5-b299-baeeee06a803 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.583336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-c55ff519-aa11-4c53-99df-4b95ae0eb340 req-3d078349-0cf5-4dc5-b299-baeeee06a803 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.596856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-c55ff519-aa11-4c53-99df-4b95ae0eb340 req-3d078349-0cf5-4dc5-b299-baeeee06a803 service nova] Creating event network-vif-plugged:ee87a707-2c23-4c29-be4e-ac7a5113509d for instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 on hv-cinder-83697 Jul 15 17:50:00.602527 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-c55ff519-aa11-4c53-99df-4b95ae0eb340 req-3d078349-0cf5-4dc5-b299-baeeee06a803 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037715 Jul 15 17:50:00.603636 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 204/412] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:00.685919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:00.691693 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:00.704104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.704732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.705615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:00.706151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:00.710685 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:00.859731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:00.867835 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5f3e0d4f-2b00-4636-8e58-a785a7c700f0 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.185852 Jul 15 17:50:00.869653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 209/413] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:00 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:01.461681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:01.463334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:01.466030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=12 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:01.472546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:01.473333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:01.474367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:01.474863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:01.575398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:01.576013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:01.582962 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:01.583419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:01.584229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:01.584713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:01.643175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:01.650880 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-429f7b57-d7e1-4e39-b3b3-2c2d5d8ba87d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.194510 Jul 15 17:50:01.651981 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 205/414] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:01 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:01.738901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:01.747259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:01.748803 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:01.750012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-08ce70aa-6937-484b-97f2-722f4b76d299 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.178586 Jul 15 17:50:01.750563 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 210/415] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:01 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:01.886030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:01.886633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:01.888497 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:01.894011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:01.894465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:01.898349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:01.898349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:02.042922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:02.054005 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9aa4c36e-27c3-4726-b7aa-c8d65107ce29 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.171900 Jul 15 17:50:02.056861 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 206/416] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:01 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:02.668028 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:02.668673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:02.670502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=8 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:02.675928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:02.676479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:02.677300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:02.677740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:02.770084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:02.774018 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:02.781591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:02.782433 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:02.783628 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:02.784452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:02.829672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:02.842903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e50e45c8-f61f-4138-b9af-d941f61eee72 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.178174 Jul 15 17:50:02.852279 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 211/417] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:02 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:02.996620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:03.007278 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:03.008946 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:03.010447 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-932c3684-9355-4217-b7c4-8a13435ab811 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.245711 Jul 15 17:50:03.011178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 207/418] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:02 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:03.076950 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:03.084838 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:03.091656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:03.092108 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:03.093013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:03.093485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:03.247405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:03.258928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-65971a0a-f517-4184-93f4-9ee2769e2d0c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.187154 Jul 15 17:50:03.269321 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 212/419] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:03 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:03.860055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:03.860810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:03.867611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:03.868058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:03.868887 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:03.869326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:04.022869 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:04.029488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:04.030197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:04.031202 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-04bb1037-2375-4d86-a8e9-293f952dbab0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.175542 Jul 15 17:50:04.031779 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 208/420] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:03 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:04.039058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:04.039944 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:04.040869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:04.041383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:04.182681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:04.193196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:04.195421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:04.197103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8b76de8d-5308-45be-981a-af6aa5783d3b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.171535 Jul 15 17:50:04.208794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 213/421] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:04 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:04.278175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:04.278980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:04.286192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:04.286730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:04.287665 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:04.288195 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:04.440903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:04.448403 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ae4ac694-6cd3-4ffa-85b8-1d8937ebc8f5 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.175643 Jul 15 17:50:04.448984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 209/422] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:04 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:05.048305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:05.049057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:05.055835 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:05.056355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:05.057291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:05.057793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:05.198435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:05.207498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f4c48e48-6115-40ab-9e85-abcc9b5f767f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.162900 Jul 15 17:50:05.220639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 214/423] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:05 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:05.222970 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:05.229284 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:05.230533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:05.230989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:05.231957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:05.232552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:05.466150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:05.466848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:05.483961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:05.484977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:05.486353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:05.487046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:05.656130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:05.671915 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-44d7ffed-ae71-4df2-ac42-8886c4a0849b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.208880 Jul 15 17:50:05.672919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 215/424] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:05 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:05.687980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:05.699059 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:05.701218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:05.703082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1a03d93f-9edf-4f75-ac60-649302bf7313 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.483855 Jul 15 17:50:05.704194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 210/425] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:05 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:06.225172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:06.227065 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:06.230741 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:06.237491 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.238263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.239196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.239848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.244788 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:06.401193 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:06.409921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5c96dbd3-6614-4a65-8883-49df8f47671d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.188872 Jul 15 17:50:06.410494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 216/426] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:06 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:06.474519 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-9d948fec-aa1e-4b84-a917-e3e2586aeb96 req-5b546860-d34b-4c56-8a7c-7c360d62bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba512d4-5596-4492-9658-a5e049dc0e46", "name": "network-vif-plugged", "status": "completed", "tag": "a25babfc-cc3c-4368-bdb2-95a6ee1ffc1a"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:06.488764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-9d948fec-aa1e-4b84-a917-e3e2586aeb96 req-5b546860-d34b-4c56-8a7c-7c360d62bba0 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.489438 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-9d948fec-aa1e-4b84-a917-e3e2586aeb96 req-5b546860-d34b-4c56-8a7c-7c360d62bba0 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.503372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-9d948fec-aa1e-4b84-a917-e3e2586aeb96 req-5b546860-d34b-4c56-8a7c-7c360d62bba0 service nova] Creating event network-vif-plugged:a25babfc-cc3c-4368-bdb2-95a6ee1ffc1a for instance dba512d4-5596-4492-9658-a5e049dc0e46 on hv-cinder-83697 Jul 15 17:50:06.509533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-9d948fec-aa1e-4b84-a917-e3e2586aeb96 req-5b546860-d34b-4c56-8a7c-7c360d62bba0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038926 Jul 15 17:50:06.513223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 211/427] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:06.690517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:06.691483 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:06.698839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.699428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.700277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.700819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.722543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:06.723250 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:06.729777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.730228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.731009 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:06.731444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:06.842177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:06.860038 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-25abcd3a-9ebd-4829-a470-77c400d177d4 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.174640 Jul 15 17:50:06.860941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 217/428] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:06 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:06.884851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:06.895303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:06.897119 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:06.898471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-750853a6-1290-479f-a235-360edb6fd968 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.180187 Jul 15 17:50:06.899581 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 212/429] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:06 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:07.427991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:07.428552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:07.435919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:07.437302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:07.438166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:07.438798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:07.602543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:07.621900 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c22240e7-d386-4419-9644-54389249ebfd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.197895 Jul 15 17:50:07.622862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 218/430] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:07 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:07.881345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:07.883156 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:07.894071 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:07.894741 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:07.895608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:07.896092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:07.916714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:07.917317 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:07.925200 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:07.925653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:07.926438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:07.926880 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:08.068441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:08.078700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ad744cd9-bdca-4616-a225-6631198fef89 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.203207 Jul 15 17:50:08.089393 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 213/431] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:07 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:08.091489 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:08.100936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:08.102471 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:08.103903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-be9bea73-8ae2-4f48-b30e-5f32c256d68b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.191283 Jul 15 17:50:08.115484 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 219/432] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:07 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:08.639858 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:08.640801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:08.647176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:08.657700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:08.657700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:08.657700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:08.793432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:08.798926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1dc72f77-9473-41e8-a289-58b032b4e5a2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.163714 Jul 15 17:50:08.799788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 214/433] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:08 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:09.099593 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:09.100285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:09.107805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:09.108566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:09.109605 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:09.110251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:09.122542 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:09.124343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:09.132771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:09.133224 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:09.135593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:09.135593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:09.325713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:09.326483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:09.336055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:09.337691 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:09.339078 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9074c4af-5b4b-4aa3-8646-9759232e5c44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.220499 Jul 15 17:50:09.339959 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 215/434] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:09 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:09.343952 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f08e5afc-07ec-4f95-8da5-0cbd81a2c192 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.251004 Jul 15 17:50:09.344730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 220/435] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:09 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:09.816571 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:09.817208 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:09.823350 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:09.823796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:09.824554 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:09.825016 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:09.960277 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:09.968446 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-181cd80e-f7c9-4f2a-bb8d-88ea0e1d52a6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.155666 Jul 15 17:50:09.969062 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 216/436] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:09 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:10.357413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:10.359023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:10.360863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:10.365753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:10.366211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:10.366989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:10.367608 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:10.367873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:10.374530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:10.375223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:10.376079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:10.376517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:10.508622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:10.517435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:10.519021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:10.520188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b0512064-7154-441e-bddf-17c8246cc0a3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.166737 Jul 15 17:50:10.520771 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 221/437] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:10 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:10.570826 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:10.578508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6168b06a-4971-4e90-bbd8-5795e7d2208c tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.221573 Jul 15 17:50:10.579062 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 217/438] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:10 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:10.987049 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:10.987671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:10.997798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:10.999449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:10.999618 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:11.000234 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:11.144342 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:11.154182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a48b7706-b8b1-410c-ab05-9b8350ea3a19 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.172115 Jul 15 17:50:11.154845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 222/439] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:10 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:11.538977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:11.539712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:11.546476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:11.546975 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:11.548034 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:11.548490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:11.553818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=100 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:11.596405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:11.597517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:11.604265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:11.604852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:11.605901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:11.606395 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:11.740868 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:11.749473 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:11.750368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:11.752262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:11.753736 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-64302d46-bc46-4fae-996b-70196d3a8363 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.218504 Jul 15 17:50:11.754528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 218/440] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:11 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:11.759305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9dead964-1dee-480f-b80e-0d5d29fc65dd tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.167792 Jul 15 17:50:11.761303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 223/441] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:11 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:12.171235 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:12.171856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:12.178044 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:12.178417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:12.179194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:12.179805 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:12.313558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:12.321341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-65b64f8f-828a-4725-b7d7-dc4037b52deb tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1318 microversion: 2.1 time: 0.154135 Jul 15 17:50:12.321902 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 219/442] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:12 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:12.773232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:12.773853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:12.781468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:12.781919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:12.782267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:12.782749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:12.783060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:12.783197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:12.793296 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:12.793825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:12.795440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:12.796638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:12.918980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:12.928175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:12.929728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:12.930891 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-967eb486-f0f0-4db7-8f8e-a6589b143d11 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.161626 Jul 15 17:50:12.931454 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 224/443] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:12 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:12.935630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:12.948792 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-858860f3-c4df-40fd-aa4d-73fac33ce491 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.166421 Jul 15 17:50:12.948792 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 220/444] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:12 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:13.338156 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:13.338769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:13.345485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:13.345937 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:13.346716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:13.347139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:13.478800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:13.487806 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-430bf746-4062-431f-b39f-554006873330 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1508 microversion: 2.1 time: 0.153310 Jul 15 17:50:13.488394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 225/445] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:13 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:13.948276 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:13.948980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:13.956247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:13.956740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:13.957517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:13.957958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:13.965113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:13.966339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:13.974054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:13.974514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:13.975348 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:13.975787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:14.095129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:14.103682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:14.105254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:14.106425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7ce3f4ea-ef1a-4a3a-a6cb-c50a71aad8d2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.162066 Jul 15 17:50:14.107017 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 221/446] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:13 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:14.109818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:14.117289 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-02d9f632-c914-4540-b8a8-4f1be1ca672f tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1314 microversion: 2.1 time: 0.156397 Jul 15 17:50:14.117828 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 226/447] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:13 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:15.125155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:15.125788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:15.132986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.133437 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.133831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:15.134223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.134528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:15.134670 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.142276 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.142717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.143487 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.143915 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.285264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:15.294351 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:15.296627 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:15.297873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-57576f1f-6d30-4c8c-934b-7c9911091fec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.176651 Jul 15 17:50:15.298444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 222/448] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:15 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:15.303271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:15.312175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fa301391-e2bb-47d7-9d35-b696d2cdb8aa tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1464 microversion: 2.1 time: 0.181982 Jul 15 17:50:15.314415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 227/449] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:15 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1464 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:15.352480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:15.353000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:15.359602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.361411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.361411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.361411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.388782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:50:15.802528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-16c68d8d-b786-4d44-ad9b-be2546e5b290 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 204 len: 0 microversion: 2.1 time: 0.453612 Jul 15 17:50:15.803099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 223/450] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:50:15 2022] DELETE /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:50:15.813720 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:15.813720 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:15.818733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.819189 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.819966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:15.820402 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:15.952187 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:15.959788 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-59aab73f-10de-40c0-8488-04e7cfa73c70 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.152367 Jul 15 17:50:15.960346 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 228/451] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:15 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:16.316704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:16.317407 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:16.323954 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:16.324408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:16.325213 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:16.325649 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:16.457937 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:16.466388 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:16.468495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:16.469680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2d3dbbdf-a37b-4889-9a0a-79b1fa4d534b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.157232 Jul 15 17:50:16.470238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 224/452] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:16 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:16.978957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:16.979515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:16.986886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:16.987429 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:16.988207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:16.988664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:17.125456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:17.133358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1ef807c8-8fe2-44d0-9919-0487e7008276 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.158416 Jul 15 17:50:17.133913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 229/453] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:16 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:17.487752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:17.488358 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:17.494924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:17.495374 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:17.496127 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:17.496559 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:17.643848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:17.652201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:17.653743 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:17.655513 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e9ad2118-243d-4771-98f3-2f466369d73f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.171070 Jul 15 17:50:17.656074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 225/454] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:17 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:18.150963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:18.151512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:18.158888 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:18.159329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:18.160095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:18.160531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:18.296019 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:18.304012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e71f74d4-aae0-4954-b563-8731b48b6f42 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.157135 Jul 15 17:50:18.304620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 230/455] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:18 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:18.673800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:18.674348 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:18.680622 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:18.681079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:18.681856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:18.682296 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:18.812590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:18.821919 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:18.823488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:18.824710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8a6f73d1-ece0-40c8-b1c2-b06b9375b8c6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.155619 Jul 15 17:50:18.825277 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 226/456] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:18 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:19.321957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:19.322568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:19.329162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:19.329616 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:19.330371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:19.330805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:19.462694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:19.471054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a2be83ed-a387-4019-915c-f8062eb709ba tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.153009 Jul 15 17:50:19.475438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 231/457] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:19 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:19.844014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:19.844764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:19.851739 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:19.852191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:19.852990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:19.853422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:19.986723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:19.995184 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:19.996727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:19.998161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c889fb37-b8aa-4afa-ae19-d4e7e999ec7f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.158895 Jul 15 17:50:19.998795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 227/458] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:19 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:20.489174 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:20.489712 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:20.496301 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:20.496806 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:20.497580 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:20.498015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:20.639883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:20.643581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:20.647989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-203d5b32-7f2a-4b55-ae00-c0faf9f5f439 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.162872 Jul 15 17:50:20.648566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 232/459] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:20 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:21.017493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:21.018120 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:21.024656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:21.025102 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:21.025855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:21.026288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:21.161177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:21.169727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:21.171280 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:21.172569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a38031ad-a60f-4ec8-8d0e-dd9109c46af3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.159712 Jul 15 17:50:21.173176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 228/460] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:21 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:21.665881 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:21.666387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:21.674706 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:21.675219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:21.676001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:21.676439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:21.827914 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:21.836797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fffce3f4-3206-4c04-b437-cfd50c834003 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.174612 Jul 15 17:50:21.837634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 233/461] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:21 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:22.191555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:22.192134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:22.199857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:22.200191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:22.201154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:22.202133 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:22.343605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:22.352414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:22.353956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:22.355112 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b1506d33-bb97-411a-98bc-4e36f0f946a7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.167747 Jul 15 17:50:22.355677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 229/462] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:22 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:22.854992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:22.855494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:22.862313 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:22.862765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:22.863537 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:22.863973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:23.015804 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:23.023923 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6ea8038e-b104-4f93-b168-4f17bb4a0f65 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.172752 Jul 15 17:50:23.024729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 234/463] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:22 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:23.373609 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:23.374215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:23.381294 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:23.381745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:23.382525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:23.382964 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:23.519366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:23.528060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:23.530155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:23.531574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fdd47d76-bff7-4e3d-b820-3fd306c16e66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.162034 Jul 15 17:50:23.532142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 230/464] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:23 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:24.041277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:24.041895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:24.048620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:24.049083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:24.049848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:24.050291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:24.226320 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:24.234164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b30d3bd9-1267-49cc-8009-0907128ea312 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.196710 Jul 15 17:50:24.234747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 235/465] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:24 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:24.550417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:24.551025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:24.557540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:24.557994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:24.558769 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:24.559359 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:24.697821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:24.707237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:24.708846 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:24.710012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e41e3e1f-4c53-424e-9fa4-5f247dc14581 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.163599 Jul 15 17:50:24.710574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 231/466] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:24 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:25.252151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:25.253540 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:25.260120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:25.260566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:25.261374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:25.261992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:25.422196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:25.430660 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a835b75e-5933-4096-94e5-aeae7e9bb66b tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.183057 Jul 15 17:50:25.431247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 236/467] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:25 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:25.729196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:25.729800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:25.737178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:25.739958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:25.741223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:25.741888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:25.940846 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:25.950139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:25.952162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:25.956800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e17a50db-c4c7-4918-be02-09cc5dfde963 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.228415 Jul 15 17:50:25.957435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 232/468] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:25 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:26.447791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:26.449137 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:26.459976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:26.462885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:26.463854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:26.467819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:26.699843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:26.722767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cff7e62e-e535-47c3-acbe-8d460a8f1436 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1470 microversion: 2.1 time: 0.279276 Jul 15 17:50:26.724691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 237/469] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:26 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:26.975879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:26.977293 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:26.984866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:26.985708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:26.986740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:26.987288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:26.992152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:27.282068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:27.308096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:27.308096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:27.308096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-78a63921-2354-4f70-981d-62b4e79352f2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.325404 Jul 15 17:50:27.313528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 233/470] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:26 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:27.740984 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:27.741854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:27.749327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:27.750164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:27.751154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:27.751990 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:27.828158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-c5c44196-5a09-4ef2-a0b4-847285fa018c req-239a6549-2414-4093-ae3d-e3a68af1914d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba512d4-5596-4492-9658-a5e049dc0e46", "name": "network-vif-deleted", "tag": "a25babfc-cc3c-4368-bdb2-95a6ee1ffc1a"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:27.839880 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-c5c44196-5a09-4ef2-a0b4-847285fa018c req-239a6549-2414-4093-ae3d-e3a68af1914d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:27.840627 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-c5c44196-5a09-4ef2-a0b4-847285fa018c req-239a6549-2414-4093-ae3d-e3a68af1914d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:27.855507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-c5c44196-5a09-4ef2-a0b4-847285fa018c req-239a6549-2414-4093-ae3d-e3a68af1914d service nova] Creating event network-vif-deleted:a25babfc-cc3c-4368-bdb2-95a6ee1ffc1a for instance dba512d4-5596-4492-9658-a5e049dc0e46 on hv-cinder-83697 Jul 15 17:50:27.862830 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-c5c44196-5a09-4ef2-a0b4-847285fa018c req-239a6549-2414-4093-ae3d-e3a68af1914d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038655 Jul 15 17:50:27.866558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 234/471] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:50:27.884803 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:27.895443 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2e4b3d69-ba45-45f1-a96b-0a501f4662b6 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1428 microversion: 2.1 time: 0.158606 Jul 15 17:50:27.904017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 238/472] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:27 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:28.325872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:28.325872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:28.325872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:28.325872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:28.327920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:28.327920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:28.468269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:28.476733 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:28.478232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:28.479371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ea0f1cbc-c5bb-4857-90b5-0ab2981da386 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.168437 Jul 15 17:50:28.479916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 235/473] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:28 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:28.913440 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:28.914055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:28.922717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:28.923324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:28.924359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:28.924818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:28.958730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:28.959181 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:28.959635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lazy-loading 'fault' on Instance uuid dba512d4-5596-4492-9658-a5e049dc0e46 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:50:29.023109 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e392abb964c48d1945b50d0f1888137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78e372e4d147469bc31a44717a1807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:29.025354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-06d5e2d8-02af-4cf4-add7-7560078f06d7 tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 200 len: 1304 microversion: 2.1 time: 0.116163 Jul 15 17:50:29.035023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 239/474] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:28 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:29.117371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-51b2e218-5e75-48f8-bf32-c282e2b6065d req-74f1637f-4078-4136-8506-00b61add129b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "name": "network-vif-plugged", "status": "completed", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:29.123252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-51b2e218-5e75-48f8-bf32-c282e2b6065d req-74f1637f-4078-4136-8506-00b61add129b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:29.123943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-51b2e218-5e75-48f8-bf32-c282e2b6065d req-74f1637f-4078-4136-8506-00b61add129b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:29.136815 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-51b2e218-5e75-48f8-bf32-c282e2b6065d req-74f1637f-4078-4136-8506-00b61add129b service nova] Creating event network-vif-plugged:9166a97f-a925-40c2-afe2-d0e85818ecf8 for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 on hv-cinder-83697 Jul 15 17:50:29.147871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-51b2e218-5e75-48f8-bf32-c282e2b6065d req-74f1637f-4078-4136-8506-00b61add129b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Jul 15 17:50:29.147871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 236/475] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:29.499213 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:29.499846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:29.506951 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:29.507369 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:29.508502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:29.508975 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:29.779767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:29.790861 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:29.792376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:29.793848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d9d4166b-e898-4f0b-9512-8b8b616ce2f3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.299506 Jul 15 17:50:29.794481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 240/476] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:29 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:30.052785 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:30.053976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] [instance: dba512d4-5596-4492-9658-a5e049dc0e46] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:30.061843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:30.062348 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:30.063581 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:30.064281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:30.083803 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] HTTP exception thrown: Instance dba512d4-5596-4492-9658-a5e049dc0e46 could not be found. Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Request method failure captured: Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 HTTP/1.1 Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0ai8H60yUhDWgeqyE5qy91sAi1U35lcJy0aWPlBGzSO_YZQ1wfnG65EA6DL3aELwYYMnxwEhyWKSCQqQKm1S56AGMR4kXmNaOupOHxYDLS6XYdHUChWcfto9GInYTM0H7QNeRSoy-E0x-0Q9AJdx4ngQsCP8LJUhMGHSTMWQrZC2J9A Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 4c78e372e4d147469bc31a44717a1807 Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesNegativeTest-807949695 Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:50:30.085810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4c78e372e4d147469bc31a44717a1807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4c78e372e4d147469bc31a44717a1807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4c78e372e4d147469bc31a44717a1807", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4c78e372e4d147469bc31a44717a1807"}]}] Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesNegativeTest-807949695 Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 4c78e372e4d147469bc31a44717a1807 Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesNegativeTest-807949695 Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesNegativeTest-807949695-project Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 0e392abb964c48d1945b50d0f1888137 Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesNegativeTest-807949695-project Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance dba512d4-5596-4492-9658-a5e049dc0e46 could not be found. Jul 15 17:50:30.087113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'dba512d4-5596-4492-9658-a5e049dc0e46'} Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba512d4-5596-4492-9658-a5e049dc0e46 could not be found. Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:50:30.087900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba512d4-5596-4492-9658-a5e049dc0e46 could not be found. Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba512d4-5596-4492-9658-a5e049dc0e46 could not be found. Jul 15 17:50:30.089818 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:50:30.092570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] Returning 404 to user: Instance dba512d4-5596-4492-9658-a5e049dc0e46 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:50:30.092570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a5d7425c-2066-4e5c-b64b-77842e6b989d tempest-VolumesNegativeTest-807949695 tempest-VolumesNegativeTest-807949695-project] 10.222.0.57 "GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46" status: 404 len: 111 microversion: 2.1 time: 0.045878 Jul 15 17:50:30.092570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 237/477] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:30 2022] GET /compute/v2.1/servers/dba512d4-5596-4492-9658-a5e049dc0e46 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:50:30.813455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:30.814073 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:30.840284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:30.842714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:30.842714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:30.842714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:31.080376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:31.099305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:31.100973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:31.102253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e09d4363-1c37-410a-b87d-04fbaa733928 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.292799 Jul 15 17:50:31.103312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 241/478] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:30 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:32.121417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:32.123592 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:32.131004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:32.132912 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:32.133644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:32.134645 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:32.135324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:32.511833 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:32.521020 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:32.522637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:32.523886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-723982cb-957b-4ac5-9e2e-86ffd9115e14 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.406682 Jul 15 17:50:32.524673 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 238/479] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:32 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:33.543559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:33.549567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:33.566939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:33.567598 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:33.568674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:33.569521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:33.809646 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:33.809646 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:33.811360 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:33.817488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3d6b1bf6-717c-44b3-b8d7-96d467819fe0 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.278026 Jul 15 17:50:33.818771 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 242/480] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:33 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:34.497155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0a3cbac-405a-468d-b3d5-97deae7694c9", "device": "/dev/sdb"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:34.499466 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:34.507998 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:34.508316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:34.509227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:34.509809 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:34.837366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:34.839062 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:34.854157 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:34.867075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:34.869851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:34.872862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:35.113190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:35.124630 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:35.130324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:35.134672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b2cc12b5-6ff6-4c65-a7e4-388287efbb18 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1806 microversion: 2.20 time: 0.302660 Jul 15 17:50:35.136324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 243/481] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:34 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1806 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:50:35.365863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fa070576-cc98-403f-b7b3-8b254e8bc8cf tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "POST /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873585 Jul 15 17:50:35.366707 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 239/482] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:50:34 2022] POST /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:36.155411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:36.157295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:36.171166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:36.171166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:36.171166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:36.171166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:36.313275 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:36.322165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:36.323660 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:36.324846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2bff8931-bf7c-485f-a59e-3ba52b1198bd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1793 microversion: 2.20 time: 0.175194 Jul 15 17:50:36.325413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 244/483] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:50:36 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1793 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:50:37.789545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a361ebab-4de9-44e9-9c73-65b09ccf42f9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Action: 'create', calling method: .version_select at 0x7f37d1794940>, body: {"keypair": {"name": "tempest-TestShelveInstance-2000020415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg+kWOcOAJDKxXU54PnSc1Ec6+W4FB01Z0t0YAQ5VyFYfErm6Fg0joCPBTnkHkSoGrxSP+acrdFKNNe+6oRBd2YybgqI3cJqepVWD6RspQjqscASAOfZsO6cqEo2SfMvA=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:37.809697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-a361ebab-4de9-44e9-9c73-65b09ccf42f9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Getting quotas for project 8d4d85b85edb4aa3b18b88ae45c3b702. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:50:37.809697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-a361ebab-4de9-44e9-9c73-65b09ccf42f9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Getting quotas for user e87a32eb7afd4eb5ae5c6cdbf06c65d1 and project 8d4d85b85edb4aa3b18b88ae45c3b702. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:50:37.917960 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a361ebab-4de9-44e9-9c73-65b09ccf42f9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328846 Jul 15 17:50:37.918980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 240/484] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:50:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:41.025059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9e4e146-63b7-423f-9675-a09357e35fd2"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:41.026306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:41.028414 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=60 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:41.033916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:41.034442 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:41.035297 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:41.035807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:41.863653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-117a4837-74a8-42aa-a0dd-94f3bed26ab2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842726 Jul 15 17:50:41.864251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 245/485] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:50:41 2022] POST /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:49.418560 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:49.419761 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=4 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:49.420404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:49.424273 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:49.424859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:49.431534 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.431982 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.434099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.434099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.459268 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-72e810e7-a0b1-4277-8cfa-c96ddfedebaa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/ips" status: 200 len: 150 microversion: 2.1 time: 0.042272 Jul 15 17:50:49.459824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 241/486] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:50:49 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:50:49.473570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c70e0b-8915-4fdc-84f2-591d136e8476"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:49.474753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:49.481589 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.482070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.482838 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.483275 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.565963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Invalid volume: volume d7c70e0b-8915-4fdc-84f2-591d136e8476 is already attached to instances: 66074efc-9ad1-4fff-89f6-b16920004511 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: POST /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/os-volume_attachments HTTP/1.1 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 74 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:50:49.567681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {"volumeAttachment": {"volumeId": "d7c70e0b-8915-4fdc-84f2-591d136e8476"}} Jul 15 17:50:49.569020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Invalid volume: volume d7c70e0b-8915-4fdc-84f2-591d136e8476 is already attached to instances: 66074efc-9ad1-4fff-89f6-b16920004511 Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'server_id': '36cd5a6a-1e60-47ed-8ccd-a19e52410f79', 'body': {'volumeAttachment': {'volumeId': 'd7c70e0b-8915-4fdc-84f2-591d136e8476'}}} Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d7c70e0b-8915-4fdc-84f2-591d136e8476 is already attached to instances: 66074efc-9ad1-4fff-89f6-b16920004511 Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:50:49.569820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d7c70e0b-8915-4fdc-84f2-591d136e8476 is already attached to instances: 66074efc-9ad1-4fff-89f6-b16920004511 Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:50:49.571517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d7c70e0b-8915-4fdc-84f2-591d136e8476 is already attached to instances: 66074efc-9ad1-4fff-89f6-b16920004511 Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 400 to user: Invalid volume: volume d7c70e0b-8915-4fdc-84f2-591d136e8476 is already attached to instances: 66074efc-9ad1-4fff-89f6-b16920004511 {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-50a0fa39-7f47-4870-8278-63b5d6cfdc7e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100646 Jul 15 17:50:49.573293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 246/487] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:50:49 2022] POST /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:50:49.579482 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:49.579978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:49.587443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.587904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.588723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.589379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.615736 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:50:49.852994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d96d8b83-dfdd-4317-b8ac-358948973699 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 204 len: 0 microversion: 2.1 time: 0.278381 Jul 15 17:50:49.853572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 242/488] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:50:49 2022] DELETE /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:50:49.862255 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:49.864639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:49.870099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.870542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:49.871303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:49.871730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:50.004354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:50.007894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:50.012283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3f303299-0ffd-4fb9-b6f6-5596d27a54b9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.153858 Jul 15 17:50:50.013514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 247/489] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:49 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:50:51.031320 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:51.031937 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:51.038431 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:51.038879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:51.039637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:51.040099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:51.178705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:51.186993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5f8eba17-c7a1-49ee-ae30-4dc4df88eb59 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.160370 Jul 15 17:50:51.187555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 243/490] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:51 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:52.205814 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:52.206396 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:52.213310 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:52.213755 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:52.214509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:52.214935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:52.350228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:52.358421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-64b2fc69-12f2-4b85-965c-089cbf3e0050 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.156749 Jul 15 17:50:52.358943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 248/491] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:52 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:53.376078 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:53.376740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:53.383538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:53.383990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:53.384795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:53.385234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:53.524267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:53.532879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7944dc49-1475-4892-9be3-df31adaed6a9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.161065 Jul 15 17:50:53.533455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 244/492] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:53 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:54.550147 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:54.550943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:54.558295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:54.558854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:54.559743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:54.560207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:54.702413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:54.715132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fe1420ab-e96b-4055-af7c-21ea79367ee7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.167426 Jul 15 17:50:54.715132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 249/493] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:54 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:55.731091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:55.731704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:55.738799 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:55.739252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:55.740022 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:55.740463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:55.886364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:55.894421 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9254b6f3-0725-47cb-9061-a979cbf7e99f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.167171 Jul 15 17:50:55.894979 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 245/494] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:55 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:56.910802 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:56.911349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:56.918260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:56.918699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:56.919454 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:56.920544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:57.071412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:57.078985 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a3e074db-acf7-4cc7-8518-83d42c1c7f07 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.172132 Jul 15 17:50:57.079549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 250/495] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:56 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:58.097824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:58.098430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:58.104879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:58.105325 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:58.106077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:58.106506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:58.233436 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:58.244564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d6145cea-18ca-409b-a4c1-2118838a0ca7 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1683 microversion: 2.1 time: 0.147282 Jul 15 17:50:58.244564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 246/496] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:58 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:58.915557 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:58.916555 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:58.923564 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:58.924015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:58.924906 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:58.925341 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:58.948904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'flavor' on Instance uuid 4a814da1-77ce-4557-9562-1e38c52ba31b {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:50:59.265543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:59.269295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:59.271632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fecc93a9-8e19-4d23-b240-91c8f667fb2e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/action" status: 200 len: 32 microversion: 2.1 time: 0.360899 Jul 15 17:50:59.272851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 251/497] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:50:58 2022] POST /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:50:59.282916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:59.284365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:50:59.285800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:59.286496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:50:59.288582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:59.288582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:59.303346 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:59.308591 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:59.308591 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:59.308591 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:59.472748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:59.482115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-90e3e7fd-4b98-42ab-8f6f-def68dffef08 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.204321 Jul 15 17:50:59.482776 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 252/498] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:59 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:59.630140 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:50:59.637876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e683560c-c140-4137-9872-96ebba61696f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1615 microversion: 2.1 time: 0.383030 Jul 15 17:50:59.638684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 247/499] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:50:59 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1615 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:50:59.878472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-259f0f36-9c1d-4131-91d1-78a3c6e288e6 req-e8f43e71-02a6-4d35-89f9-64da281edd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36cd5a6a-1e60-47ed-8ccd-a19e52410f79", "name": "network-vif-deleted", "tag": "12027af2-ea3d-40e3-883b-ba21676944b9"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:50:59.878472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-259f0f36-9c1d-4131-91d1-78a3c6e288e6 req-e8f43e71-02a6-4d35-89f9-64da281edd4a service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:50:59.878472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-259f0f36-9c1d-4131-91d1-78a3c6e288e6 req-e8f43e71-02a6-4d35-89f9-64da281edd4a service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:50:59.878472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-259f0f36-9c1d-4131-91d1-78a3c6e288e6 req-e8f43e71-02a6-4d35-89f9-64da281edd4a service nova] Creating event network-vif-deleted:12027af2-ea3d-40e3-883b-ba21676944b9 for instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 on hv-cinder-83697 Jul 15 17:50:59.880425 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-259f0f36-9c1d-4131-91d1-78a3c6e288e6 req-e8f43e71-02a6-4d35-89f9-64da281edd4a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044742 Jul 15 17:50:59.880425 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 253/500] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:00.499505 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:00.500347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:00.507604 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:00.508500 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:00.509438 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:00.510103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:00.657112 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:00.658613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:00.665930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:00.669872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:00.674023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:00.674984 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:00.675536 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:00.680012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-65ada81c-c8b9-42df-a2e4-8f0e0c7632db tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.184552 Jul 15 17:51:00.687935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 248/501] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:00 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:00.709507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:00.709973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:00.710398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lazy-loading 'fault' on Instance uuid 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:00.756182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:00.765169 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2ae76e85-6bc9-429c-bcaa-84df90eb5877 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 200 len: 1332 microversion: 2.1 time: 0.113227 Jul 15 17:51:00.765760 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 254/502] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:00 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:01.697057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:01.697664 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:01.705594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:01.706040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:01.706803 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:01.707233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:01.783295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:01.783811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:01.790989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:01.791439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:01.792206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:01.792677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:01.807344 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 HTTP/1.1 Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:51:01.809007 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:51:01.810498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '36cd5a6a-1e60-47ed-8ccd-a19e52410f79'} Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:51:01.811355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:51:01.812573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:01.813732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:51:01.813732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3c5cb8b2-39cb-42f4-9d8e-47ddec76240a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 404 len: 111 microversion: 2.1 time: 0.031802 Jul 15 17:51:01.813732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 255/503] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:01 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:51:01.819530 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8ffc1dec-bb6a-4b87-b597-a03e6ffad66c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '.version_select at 0x7f37d17ceca0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:01.843787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:01.851817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-58df3a4b-f5a0-486e-8f94-fc810c9f2877 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.158586 Jul 15 17:51:01.852379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 249/504] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:01 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:01.951680 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8ffc1dec-bb6a-4b87-b597-a03e6ffad66c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114154958" status: 202 len: 0 microversion: 2.1 time: 0.135412 Jul 15 17:51:01.952252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 256/505] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 15 17:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114154958 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:51:02.781631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:02.782154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:02.788517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:02.789000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:02.789764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:02.790200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:02.871511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:02.872205 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:02.879918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:02.880384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:02.881468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:02.881869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:02.914330 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lazy-loading 'services' on Instance uuid 66074efc-9ad1-4fff-89f6-b16920004511 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:03.012961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:03.021685 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a4fc21e8-af99-4177-a902-ed7eca0e84ec tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.156115 Jul 15 17:51:03.025874 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 257/506] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:02 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:03.149234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2a3ccedc-471c-4274-a7aa-b75138aeceac tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments/d7c70e0b-8915-4fdc-84f2-591d136e8476" status: 202 len: 0 microversion: 2.1 time: 0.371825 Jul 15 17:51:03.149751 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 250/507] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:51:02 2022] DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments/d7c70e0b-8915-4fdc-84f2-591d136e8476 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:51:03.158644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:03.159791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:03.166572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:03.166990 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:03.167836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:03.168293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:03.198742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-780df850-89d5-4a42-9f9a-637519cbe7ff tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Jul 15 17:51:03.199330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 258/508] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:51:03 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:03.551663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:03.552533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:03.559611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:03.560067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:03.560871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:03.561314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:03.608277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2117969382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2000020415", "security_groups": [{"name": "tempest-secgroup-smoke-652074401"}], "networks": [{"uuid": "d2b4a19a-fb95-4464-b965-0ab54046bd27"}], "block_device_mapping_v2": [{"uuid": "bdcc4303-ec8f-4996-9508-31a87650a1ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:03.645272 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lazy-loading 'services' on Instance uuid cda2df16-ace1-4f74-a2a1-a14156d5eec4 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:03.720266 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] validate_networks() for [('d2b4a19a-fb95-4464-b965-0ab54046bd27', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:51:03.859134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ea52c9a3-9b29-49ec-816c-448b5af4c9e2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4/os-volume_attachments/e0a3cbac-405a-468d-b3d5-97deae7694c9" status: 202 len: 0 microversion: 2.1 time: 0.311560 Jul 15 17:51:03.863776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 251/509] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:51:03 2022] DELETE /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4/os-volume_attachments/e0a3cbac-405a-468d-b3d5-97deae7694c9 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:51:04.039039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:04.039677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:04.046526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:04.046986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:04.047899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:04.048196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:04.122907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:51:04.123451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:51:04.123912 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:51:04.124769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:51:04.125244 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:51:04.134350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:04.134969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:04.135952 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:04.136392 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:04.158405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Getting quotas for project 8d4d85b85edb4aa3b18b88ae45c3b702. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:51:04.163186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Getting quotas for user e87a32eb7afd4eb5ae5c6cdbf06c65d1 and project 8d4d85b85edb4aa3b18b88ae45c3b702. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:51:04.190057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:04.198466 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7ced047e-70fb-4606-b9fb-cb79145d75f2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.163615 Jul 15 17:51:04.199256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 252/510] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:04 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:04.210497 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:04.211541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:04.217696 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:04.218271 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:04.219040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:04.219479 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:04.224552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:51:04.226662 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdcc4303-ec8f-4996-9508-31a87650a1ec',volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:51:04.250767 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fd6d9575-ca5e-42ca-9b1d-c2b93406b722 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Jul 15 17:51:04.251346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 253/511] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:51:04 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:04.665624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a38a61d0-1ead-4709-bdc9-f79b22a2d0dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.061226 Jul 15 17:51:04.666417 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 259/512] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:51:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 17:51:04.677264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b56fa4d6-4ca0-4aa8-89f0-696b903dc0bb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:04.677901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b56fa4d6-4ca0-4aa8-89f0-696b903dc0bb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:04.730874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b56fa4d6-4ca0-4aa8-89f0-696b903dc0bb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:04.739437 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b56fa4d6-4ca0-4aa8-89f0-696b903dc0bb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1089 microversion: 2.1 time: 0.066059 Jul 15 17:51:04.740205 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 254/513] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:04 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:05.218225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:05.218839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:05.232071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.232522 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.233538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.234186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.262809 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:05.264394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:05.272008 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.272921 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.273343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.273790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.299559 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:05.303804 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4d60c272-41f5-4a1e-8227-7fd7c199055d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045096 Jul 15 17:51:05.304387 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 255/514] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:51:05 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:51:05.368756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:05.369370 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:05.376295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.376790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.377839 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.378285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.383721 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:05.394068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f3443d46-6a8b-4d2f-9060-4bb75f97286f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.181421 Jul 15 17:51:05.394644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 260/515] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:05 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:05.403719 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:51:05.628302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:05.628840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:05.634884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.635334 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.636097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.636534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.766716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lazy-loading 'services' on Instance uuid 3134e969-15cb-4cac-a35d-a4543cfa8629 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:05.875526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-eb8f0b46-f8c4-426b-abc4-c2fc707e0955 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 204 len: 0 microversion: 2.1 time: 0.510591 Jul 15 17:51:05.876117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 256/516] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:51:05 2022] DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:51:05.881452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:05.885252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:05.888035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.888486 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.889304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.889742 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.952837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:05.960494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1b00a468-69f2-40dd-bbfc-5d667ce0391f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1139 microversion: 2.1 time: 0.083217 Jul 15 17:51:05.961168 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 257/517] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:05 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:05.965574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:05.966176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:05.972695 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.973143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:05.973902 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:05.974332 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.086441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7afab661-f290-484d-8d0e-fb9147859078 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-volume_attachments/10309093-fb36-4621-ae32-4ef0a35c6997" status: 202 len: 0 microversion: 2.1 time: 0.462273 Jul 15 17:51:06.087079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 261/518] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:51:05 2022] DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-volume_attachments/10309093-fb36-4621-ae32-4ef0a35c6997 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:51:06.092636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:06.095750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:06.099867 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.100318 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.101179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.101618 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.115765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:06.124297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-aede62bc-5f7a-484f-9f58-71b34c97a5fb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1682 microversion: 2.1 time: 0.162076 Jul 15 17:51:06.125067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 258/519] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:05 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:06.131118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:51:06.219418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:06.367174 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-893a7d5a-0c47-4960-99fb-fef19ea65da8 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 204 len: 0 microversion: 2.1 time: 0.278598 Jul 15 17:51:06.367678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 262/520] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:51:06 2022] DELETE /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:51:06.376094 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:06.376732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:06.383401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.384276 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.384578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.385032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.411706 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:06.412513 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:06.418796 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.419247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.420012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.420443 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.518904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:06.526420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-cc439e65-f5df-425f-a6e3-fe8fd1b529b0 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1514 microversion: 2.1 time: 0.154256 Jul 15 17:51:06.527036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 259/521] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:06 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:06.551755 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:06.559833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-caaeb281-cf11-4493-831a-ba3490b859e2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.152350 Jul 15 17:51:06.563152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 263/522] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:06 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:06.977733 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:06.978263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:06.984432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.984917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:06.985692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:06.986129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.045241 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:07.052468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a19e2e57-2410-4db8-861c-08c6fc0b60a5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1139 microversion: 2.1 time: 0.078644 Jul 15 17:51:07.053034 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 260/523] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:06 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1139 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:07.141958 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:07.142573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:07.148616 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:07.149097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.149856 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:07.150295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.282647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:07.290434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-69c11ff3-08be-4d19-8033-dd104c0a8540 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1682 microversion: 2.1 time: 0.152347 Jul 15 17:51:07.290999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 264/524] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:07 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:07.544105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:07.544695 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:07.551327 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:07.551772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.552533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:07.553035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.577622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:07.581786 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:07.584209 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:07.584677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.585433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:07.585861 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:07.703729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:07.711273 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9898cbda-698a-48d4-8759-7db037822b9c tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1514 microversion: 2.1 time: 0.171362 Jul 15 17:51:07.711836 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 261/525] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:07 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:07.717332 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:07.725290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f467caba-303c-48ac-bc8d-41ff556c59bd tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.152061 Jul 15 17:51:07.726436 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 265/526] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:07 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:08.069763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:08.070366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:08.076652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.077103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.077906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.078372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.137819 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:08.145250 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-877bc554-3ea8-4bea-9b9c-76b66bf3e285 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1139 microversion: 2.1 time: 0.079404 Jul 15 17:51:08.145804 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 262/527] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:08 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:08.307263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:08.307898 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:08.314361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.314805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.315559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.315989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.441951 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:08.449614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-259a9304-3c9d-4cfd-9629-04a8aad7e571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1682 microversion: 2.1 time: 0.146148 Jul 15 17:51:08.450189 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 266/528] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:08 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:08.728298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:08.729015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:08.735593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.736081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.736878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.737319 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.742366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:08.743009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:08.749009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.749466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.750230 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:08.750669 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:08.872203 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:08.880040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7d54c18e-a372-456a-bd41-47eb3773b69d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1514 microversion: 2.1 time: 0.155561 Jul 15 17:51:08.880627 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 263/529] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:08 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:08.893924 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:08.901763 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3d72885f-9b25-4862-9a37-a23215404a6b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.163254 Jul 15 17:51:08.902314 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 267/530] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:08 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:09.160854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:09.161463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:09.167506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.167955 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.168784 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.169260 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.243168 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:09.251700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4432fa22-8f76-4824-abf2-7b48f905e62d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1139 microversion: 2.1 time: 0.094675 Jul 15 17:51:09.253943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 264/531] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:09 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:09.468011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:09.469297 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:09.479467 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.479956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.480807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.481249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.648773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:09.658245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4884eaac-9dd8-491b-af7b-727fcd6fb3f0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1682 microversion: 2.1 time: 0.193519 Jul 15 17:51:09.659127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 268/532] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:09 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:09.908326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:09.908326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:09.908326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.908326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.909230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.909230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.919183 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:09.921914 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:09.931543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.932846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:09.934083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:09.934532 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.080621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:10.092173 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b0ca186f-85dc-4ff0-b143-6c550c5c2f7a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.176589 Jul 15 17:51:10.102544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 269/533] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:09 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:10.189918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:10.199405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-33237d9f-d79e-4074-885d-55ba33428aef tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1514 microversion: 2.1 time: 0.306266 Jul 15 17:51:10.211734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 265/534] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:09 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:10.269189 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:10.269801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:10.276421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.276421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.277022 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.277457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.344675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:10.355023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a6b8fd23-a9af-49c6-850d-83f4a3d4306a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1187 microversion: 2.1 time: 0.088237 Jul 15 17:51:10.364175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 270/535] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:10 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:10.369668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d5c83380-248b-4b87-9666-e3b8f5d4cec3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:10.384521 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d5c83380-248b-4b87-9666-e3b8f5d4cec3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.385337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d5c83380-248b-4b87-9666-e3b8f5d4cec3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.412200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d5c83380-248b-4b87-9666-e3b8f5d4cec3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Going to try to stop instance {{(pid=124745) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 15 17:51:10.629210 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-bde00e1a-5ef1-44a3-94cb-c718aa93c656 req-6dae3706-4d51-4033-9687-d824f8b51c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66074efc-9ad1-4fff-89f6-b16920004511", "name": "network-vif-deleted", "tag": "61f90384-5142-4b61-b7be-b8f00310b1fa"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:10.639305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-bde00e1a-5ef1-44a3-94cb-c718aa93c656 req-6dae3706-4d51-4033-9687-d824f8b51c28 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.640029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-bde00e1a-5ef1-44a3-94cb-c718aa93c656 req-6dae3706-4d51-4033-9687-d824f8b51c28 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.657993 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-bde00e1a-5ef1-44a3-94cb-c718aa93c656 req-6dae3706-4d51-4033-9687-d824f8b51c28 service nova] Creating event network-vif-deleted:61f90384-5142-4b61-b7be-b8f00310b1fa for instance 66074efc-9ad1-4fff-89f6-b16920004511 on hv-cinder-83697 Jul 15 17:51:10.662994 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-bde00e1a-5ef1-44a3-94cb-c718aa93c656 req-6dae3706-4d51-4033-9687-d824f8b51c28 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038198 Jul 15 17:51:10.664083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 271/536] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:10.675436 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d5c83380-248b-4b87-9666-e3b8f5d4cec3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action" status: 202 len: 0 microversion: 2.1 time: 0.311387 Jul 15 17:51:10.676790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 266/537] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:51:10 2022] POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:51:10.685465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:10.686176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:10.692911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:10.693691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:10.700854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.702897 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.706367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.706981 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.709945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.710400 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.711190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:10.714232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:10.823020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:10.837119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4d027be7-cf12-4036-80c9-a7a7cbd089f1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1614 microversion: 2.1 time: 0.158515 Jul 15 17:51:10.848545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 272/538] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:10 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1614 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:10.953487 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:10.961507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ca64ef8a-dfa0-4606-8ca2-2c13a3f9c840 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.280360 Jul 15 17:51:10.962077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 267/539] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:10 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:11.110201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:11.110883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:11.112912 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:11.118107 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.118557 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.119332 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.119765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.218035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:11.218709 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:11.230151 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.231209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.234300 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.234300 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.271820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:11.282035 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-39148b06-ae91-4146-a435-5f89badd240c tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.176174 Jul 15 17:51:11.282874 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 273/540] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:11 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:11.323347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:11.331414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-31d8b63f-6459-4745-be5c-ae8f174c5722 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1303 microversion: 2.1 time: 0.117795 Jul 15 17:51:11.331981 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 268/541] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:11 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:11.378070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:11.378070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:11.378699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.379220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.380905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.380905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.449928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:11.458653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4635f685-9222-423e-92f1-2f6bcb00e184 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1205 microversion: 2.1 time: 0.091043 Jul 15 17:51:11.459518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 274/542] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:11 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:11.861788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:11.861788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:11.872384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.873015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.874053 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.874498 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.914369 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.915037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.915675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lazy-loading 'fault' on Instance uuid 66074efc-9ad1-4fff-89f6-b16920004511 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:11.921774 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:11.969483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:11.979476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:11.980234 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:11.982311 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7a68fbbf-d9c5-400c-b7c7-03043adaf90c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 200 len: 1331 microversion: 2.1 time: 0.130829 Jul 15 17:51:11.982956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 269/543] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:11 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:11.988019 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.988588 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:11.989531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:11.990032 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.131311 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:12.140153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b9dc1f96-b5d4-4655-941f-1be8c09e092a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.164856 Jul 15 17:51:12.140794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 275/544] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:11 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:12.299543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:12.300437 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:12.307333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.307993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.308967 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.309405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.349787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:12.350494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:12.359441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.359888 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.360760 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.361186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.394894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.395337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.395781 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lazy-loading 'fault' on Instance uuid cda2df16-ace1-4f74-a2a1-a14156d5eec4 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:12.443191 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:12.451501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-188109d6-ded6-4c26-9c41-10e1cc43905b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 200 len: 1308 microversion: 2.1 time: 0.105025 Jul 15 17:51:12.456631 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 276/545] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:12 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:12.477428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:12.478251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:12.484836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.485361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.486190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.486901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.514084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:12.514084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-20371587-7352-4d14-9370-0fca6f0406a3 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.217375 Jul 15 17:51:12.516943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 270/546] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:12 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:12.627013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:12.635742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dd7a6e19-4065-4a26-b86a-7441eb5f01c6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1272 microversion: 2.1 time: 0.161716 Jul 15 17:51:12.636356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 277/547] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:12 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:12.746040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-74a250f4-d47f-4052-bbb1-5282b2871045 req-7022cdcc-c703-42a6-a5f0-fbf8c56d37c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda2df16-ace1-4f74-a2a1-a14156d5eec4", "name": "network-vif-deleted", "tag": "ee87a707-2c23-4c29-be4e-ac7a5113509d"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:12.756316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-74a250f4-d47f-4052-bbb1-5282b2871045 req-7022cdcc-c703-42a6-a5f0-fbf8c56d37c7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:12.757270 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-74a250f4-d47f-4052-bbb1-5282b2871045 req-7022cdcc-c703-42a6-a5f0-fbf8c56d37c7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:12.771408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-74a250f4-d47f-4052-bbb1-5282b2871045 req-7022cdcc-c703-42a6-a5f0-fbf8c56d37c7 service nova] Creating event network-vif-deleted:ee87a707-2c23-4c29-be4e-ac7a5113509d for instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 on hv-cinder-83697 Jul 15 17:51:12.776407 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-74a250f4-d47f-4052-bbb1-5282b2871045 req-7022cdcc-c703-42a6-a5f0-fbf8c56d37c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Jul 15 17:51:12.777139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 271/548] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:13.007714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:13.008366 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:13.015673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.016210 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.017086 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.017527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.031615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 HTTP/1.1 Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:51:13.033673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:51:13.035216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '66074efc-9ad1-4fff-89f6-b16920004511'} Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:51:13.036177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:51:13.037677 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.039057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:51:13.039057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-88fb28fc-c581-481f-a905-9b10d3ee7e61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 404 len: 111 microversion: 2.1 time: 0.031420 Jul 15 17:51:13.039057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 278/549] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:13 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:51:13.045647 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e2391d39-844c-4e0f-9544-52983da2ce2d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '.version_select at 0x7f37d15aadc0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:13.145488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e2391d39-844c-4e0f-9544-52983da2ce2d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-584927620" status: 202 len: 0 microversion: 2.1 time: 0.104909 Jul 15 17:51:13.147418 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 272/550] 10.222.0.57 () {58 vars in 1217 bytes} [Fri Jul 15 17:51:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-584927620 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:51:13.157926 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:13.158541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:13.164793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.165899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.166694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.167139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.357752 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:13.366196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c74ad617-0ced-4ac1-98cb-eddb1852a9b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.212246 Jul 15 17:51:13.366497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 279/551] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:13 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:13.471360 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:13.472164 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: cda2df16-ace1-4f74-a2a1-a14156d5eec4] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:13.484117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.484681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.485505 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.485942 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.502705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] HTTP exception thrown: Instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 could not be found. Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Request method failure captured: Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 HTTP/1.1 Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0ai3OeINDQKrUTXFEM5BwXHLCvkwGTYwIqu2ctCXcnvx7xouU9CyL6CFLF8Yb_NDJs_ws3WU1ntkzKMsPY-UlFy-fd-bCj9yjU8bc19svVFw8S-u2cUfkIYlouy8WRDmUccrOUbSz9muKCmlTjdk3TSxq3dWk471-Jn5hfkViIjEn7c Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d6aa269b9af048c1860128aa8db2bf28 Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1276326184 Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:51:13.504994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6aa269b9af048c1860128aa8db2bf28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6aa269b9af048c1860128aa8db2bf28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6aa269b9af048c1860128aa8db2bf28", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6aa269b9af048c1860128aa8db2bf28"}]}] Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesSnapshotTestJSON-1276326184 Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d6aa269b9af048c1860128aa8db2bf28 Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1276326184 Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesSnapshotTestJSON-1276326184-project Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 611f51a2f6434e0ab78559d8b03493df Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesSnapshotTestJSON-1276326184-project Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 could not be found. Jul 15 17:51:13.506536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'cda2df16-ace1-4f74-a2a1-a14156d5eec4'} Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 could not be found. Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:51:13.507478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 could not be found. Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 could not be found. Jul 15 17:51:13.508878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:13.510041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Returning 404 to user: Instance cda2df16-ace1-4f74-a2a1-a14156d5eec4 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:51:13.510041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f6c28d6a-2021-45bc-a312-ee9b45f1bb33 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4" status: 404 len: 111 microversion: 2.1 time: 0.041642 Jul 15 17:51:13.510041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 273/552] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:13 2022] GET /compute/v2.1/servers/cda2df16-ace1-4f74-a2a1-a14156d5eec4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:51:13.531345 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:13.531985 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:13.539024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.539506 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.540278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.540774 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.566438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:13.652622 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:13.653237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:13.660461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.660943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.661719 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:13.662160 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:13.869642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:13.878997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8de23ec5-5353-4240-8f46-df819ab418cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.230157 Jul 15 17:51:13.879578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 274/553] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:13 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:13.970312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:13.978458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8f79b221-173e-4f65-886e-784289b0d45a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.451603 Jul 15 17:51:13.979180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 280/554] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:13 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:14.351218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b3e13fc4-72c1-431a-82d0-4a1beab12edd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: .version_select at 0x7f37d144e3a0>, body: {"keypair": {"name": "tempest-keypair-2066467603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPRbcsXal/3Qx8IRFvu7HyNlLtrLU61ECQC8HAPoHCY/cgDtDsYzs1NDaN9czujHDVYIjme1We1ywXV/bV8loI+AVd1xoz9zkrwyFfEgBasq1bnHdVW8mxC1BxXEYh0RQ=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:14.365504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-b3e13fc4-72c1-431a-82d0-4a1beab12edd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:51:14.369269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-b3e13fc4-72c1-431a-82d0-4a1beab12edd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:51:14.384082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:14.384811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:14.387253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:14.388091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=6 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:14.393561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:14.394009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:14.395749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:14.395749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:14.425546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b3e13fc4-72c1-431a-82d0-4a1beab12edd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078040 Jul 15 17:51:14.426247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 275/555] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:51:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:14.525031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:14.533475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3a5847c0-3db0-47de-9ae4-cc3baf8049f1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.153959 Jul 15 17:51:14.534039 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 281/556] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:14 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:14.801780 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-e6a81285-a394-4d93-84ce-af9d8d14998f req-dd5e5c05-2bea-46b5-b510-4cb47f7b7803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:14.806341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:14.810936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-e6a81285-a394-4d93-84ce-af9d8d14998f req-dd5e5c05-2bea-46b5-b510-4cb47f7b7803 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:14.811381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-e6a81285-a394-4d93-84ce-af9d8d14998f req-dd5e5c05-2bea-46b5-b510-4cb47f7b7803 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:14.821997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-e6a81285-a394-4d93-84ce-af9d8d14998f req-dd5e5c05-2bea-46b5-b510-4cb47f7b7803 service nova] Creating event network-changed:0dad5793-1312-4eb3-912c-d33ba3dd6b43 for instance 2e8e11f1-2777-4750-9a76-49660282b01d on hv-cinder-83697 Jul 15 17:51:14.827150 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-e6a81285-a394-4d93-84ce-af9d8d14998f req-dd5e5c05-2bea-46b5-b510-4cb47f7b7803 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029126 Jul 15 17:51:14.827723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 276/557] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:14.897135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:14.897857 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:14.904709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:14.905206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:14.906002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:14.906581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:15.008823 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:15.009526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:15.016767 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:15.017221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:15.018025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:15.018462 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:15.037690 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:15.046252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4db47f1a-8faf-4cb7-9d0c-5f4a33b1124a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.153632 Jul 15 17:51:15.055449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 282/558] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:14 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:15.168397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:15.177611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ec6e8d2c-eb4b-4732-aff3-986af4dba9e1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.173372 Jul 15 17:51:15.178179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 277/559] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:15 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:15.557877 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:15.558475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:15.565948 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:15.566386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:15.567180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:15.567603 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:15.764560 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:15.771705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-67fa9bf8-203d-41e6-b236-185f773a0edb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.217739 Jul 15 17:51:15.772277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 283/560] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:15 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:16.064392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:16.065550 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:16.072422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:16.072899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:16.073730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:16.074168 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:16.195302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:16.195916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:16.202638 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:16.203308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:16.204114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:16.204747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:16.405553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:16.413902 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-82bc9262-c1a8-4556-be88-71313ab253f4 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.222396 Jul 15 17:51:16.414562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 284/561] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:16 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:16.478265 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:16.486196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b3ee2541-bf40-4b37-8651-4adc5a5d5092 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.426909 Jul 15 17:51:16.486859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 278/562] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:16 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:16.789464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:16.790097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:16.797325 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:16.797778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:16.798597 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:16.799030 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:16.905834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-279802476", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9128f0d2-178e-413a-a0d2-d7efa1403a9e"}], "security_groups": [{"name": "tempest-securitygroup--51294117"}], "key_name": "tempest-keypair-2066467603", "user_data": "}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:16.933814 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:16.941680 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d2a5169e-7e6c-4598-be33-8651d43152fe tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.156209 Jul 15 17:51:16.942368 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 285/563] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:16 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:17.007876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] validate_networks() for [('9128f0d2-178e-413a-a0d2-d7efa1403a9e', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:51:17.431303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:17.431952 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:17.438526 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.438973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.439747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.440187 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.481981 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:51:17.482473 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:51:17.482859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:51:17.483264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:51:17.483678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:51:17.492471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.492952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.493738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.494255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.511634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:51:17.516624 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:51:17.527777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:51:17.531509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:51:17.581508 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:17.589541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-24dc1364-74ba-4740-beb5-203dadcfbb0d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.162120 Jul 15 17:51:17.590113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 286/564] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:17 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:17.594473 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:17.595075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:17.600818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.601265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.602035 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.602463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.685720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e123d19d-b34b-4d63-b965-fbd693a69e53 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.784238 Jul 15 17:51:17.686373 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 279/565] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:51:16 2022] POST /compute/v2.1/servers => generated 400 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 17:51:17.696324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-405aada0-ae47-43a1-b6c2-8db3d2dc6990 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:17.697101 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-405aada0-ae47-43a1-b6c2-8db3d2dc6990 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:17.741202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:17.755252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-405aada0-ae47-43a1-b6c2-8db3d2dc6990 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:17.756726 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e00ade96-4d94-413c-9fe3-cdee4099ea43 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.165539 Jul 15 17:51:17.763850 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-405aada0-ae47-43a1-b6c2-8db3d2dc6990 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1241 microversion: 2.1 time: 0.071269 Jul 15 17:51:17.764580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 280/566] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:17 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:17.765876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 287/567] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:17 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:17.959724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:17.960288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:17.966790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.967246 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:17.968013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:17.968583 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.109701 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:18.118674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f978ad1b-0392-4c3c-b4fc-53b4e43dae40 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.162092 Jul 15 17:51:18.119574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 281/568] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:17 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:18.607303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:18.607916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:18.614351 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:18.614815 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.615588 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:18.616021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.753951 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:18.762313 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9d4c3395-4f68-4219-bfd9-63a44cdbafe0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.158800 Jul 15 17:51:18.763678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 288/569] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:18 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:18.777077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:18.777810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:18.780494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:18.781551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:18.785697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:18.786506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.787301 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:18.787769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.788527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:18.788997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.789129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:18.789718 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:18.854059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:18.861803 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fbb87e4a-86fd-4633-b993-4fa51854afbf tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1245 microversion: 2.1 time: 0.085048 Jul 15 17:51:18.862673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 289/570] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:18 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:18.951747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:18.959470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3cab0ece-0e53-4e58-9ab2-ba8f1535172e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.189653 Jul 15 17:51:18.960033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 282/571] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:18 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:19.136229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:19.136868 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:19.142925 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.143372 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.144134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.144571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.272923 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:19.280423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-016148da-239d-4912-9a1c-d9fe663ac41d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.148148 Jul 15 17:51:19.281126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 290/572] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:19 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:19.779870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:19.780480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:19.787018 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.787467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.788227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.788691 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.879479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:19.880097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:19.886290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.886743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.887518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.887955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.919929 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:19.939132 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e5e73579-2265-4646-a5f8-781037e85e9f tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1737 microversion: 2.1 time: 0.163728 Jul 15 17:51:19.939752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 283/573] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:19 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:19.957615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:19.965108 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3a1af42c-6abf-4b95-93b7-2c9715091d91 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1237 microversion: 2.1 time: 0.089648 Jul 15 17:51:19.965670 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 291/574] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:19 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:19.975909 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:19.976524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:19.983210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.983666 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:19.984443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:19.984910 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:20.132957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:20.140576 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a0082064-27d2-47c2-ba4f-046d8bee9774 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.168530 Jul 15 17:51:20.141168 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 284/575] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:19 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:20.298285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:20.298919 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:20.305029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:20.305479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:20.306228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:20.306655 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:20.436344 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:20.443767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-019f863a-7ad6-4906-b472-4b00206e429c tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.149892 Jul 15 17:51:20.444324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 292/576] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:20 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:20.956750 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:20.957358 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:20.963807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:20.964250 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:20.965030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:20.965462 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:20.981837 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:20.982371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:20.988836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:20.989290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:20.990067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:20.990503 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.051521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:21.059132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b3e9a2c3-5bf3-4ac0-a98e-7deafdeac92d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1237 microversion: 2.1 time: 0.081266 Jul 15 17:51:21.060208 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 293/577] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:20 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:21.098902 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:21.107217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-dfe76de4-9d93-4cfe-9b4d-09f6aeaf53ee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1717 microversion: 2.1 time: 0.154359 Jul 15 17:51:21.107779 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 285/578] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:20 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:21.157056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:21.157665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:21.163594 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.164044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.164943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.165375 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.213392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:21.213888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:21.220446 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.221160 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.222312 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.222979 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.298514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:21.306118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d9a664a5-2964-4591-b30b-bd0efc80ad2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.152900 Jul 15 17:51:21.306809 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 294/579] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:21 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:21.308829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] HTTP exception thrown: Cannot 'detach_volume' instance 4a814da1-77ce-4557-9562-1e38c52ba31b while it is in vm_state rescued Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Request method failure captured: Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments/d9e4e146-63b7-423f-9675-a09357e35fd2 HTTP/1.1 Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aguD8a54fCYXtt_8xQTS9O_epgiN-k-ksFDGtFTfK1PazWjUqu_K0Ie0Beu1FE2Cuvy-u1Y33ciAtRXlbauO8FGqg1zJ7p58sAwkO_0EjuoIaWc_HKOAbSx8a3Tb4F2dtx8-Gx2bXpyVWoWdRgPnm_nUOEDByLRwt7XvRrV2TUbOZ4 Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:51:21.311188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/882c7039b37f45f8843752b457525d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_882c7039b37f45f8843752b457525d9b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}] Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 8873b1c9f58a4adea93ebe21f5f3263d Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:51:21.312841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Cannot 'detach_volume' instance 4a814da1-77ce-4557-9562-1e38c52ba31b while it is in vm_state rescued Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'server_id': '4a814da1-77ce-4557-9562-1e38c52ba31b', 'id': 'd9e4e146-63b7-423f-9675-a09357e35fd2'} Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:51:21.313594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4a814da1-77ce-4557-9562-1e38c52ba31b while it is in vm_state rescued Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4a814da1-77ce-4557-9562-1e38c52ba31b while it is in vm_state rescued Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:21.314990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Returning 409 to user: Cannot 'detach_volume' instance 4a814da1-77ce-4557-9562-1e38c52ba31b while it is in vm_state rescued {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:51:21.316111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d0512434-18b5-46aa-a98d-a7fece0a139d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments/d9e4e146-63b7-423f-9675-a09357e35fd2" status: 409 len: 152 microversion: 2.1 time: 0.103317 Jul 15 17:51:21.316111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 286/580] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:51:21 2022] DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments/d9e4e146-63b7-423f-9675-a09357e35fd2 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 15 17:51:21.321194 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:21.321716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:21.328158 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.328615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.329370 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.329801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.460155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:21.460805 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:21.466928 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.467367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.468119 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.468640 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.569068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9fe735c9-4cdb-4165-b583-3881daf3dd1b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "POST /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/action" status: 202 len: 0 microversion: 2.1 time: 0.251306 Jul 15 17:51:21.572851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 295/581] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:51:21 2022] POST /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:51:21.578525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:21.579310 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:21.585545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.586023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.591330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:21.591330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:21.591549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:21.602575 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:21.610680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-65b86a5d-988e-4e60-975e-6aad4fb50611 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.154325 Jul 15 17:51:21.611246 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 287/582] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:21 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:21.721618 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:21.729909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1cfa89da-ccb4-46aa-90d8-5cda3b34b03b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1725 microversion: 2.1 time: 0.155539 Jul 15 17:51:21.730468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 296/583] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:21 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:22.076478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:22.077123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:22.083630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.084081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.084878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.085343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.146515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:22.154459 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bf04bc0f-0316-47e5-a6e3-38855bb045e5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1237 microversion: 2.1 time: 0.081879 Jul 15 17:51:22.155024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 288/584] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:22 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:22.323187 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:22.323792 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:22.330784 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.331164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.331910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.332337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.459214 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:22.467258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-81e4dce0-1680-4f38-a7b0-6c911e44e458 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.147868 Jul 15 17:51:22.467814 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 297/585] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:22 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:22.628584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:22.629144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:22.635117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.635560 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.636322 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.636794 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.747657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:22.748270 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:22.754548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.754995 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.755770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:22.756201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:22.768739 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:22.776442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-21c26481-41ea-47f8-a9ea-3662ea139dea tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.151996 Jul 15 17:51:22.777051 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 289/586] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:22 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:22.887417 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:22.895518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f68e7008-19bf-4f07-8702-84daafef924b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1725 microversion: 2.1 time: 0.152141 Jul 15 17:51:22.896087 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 298/587] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:22 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:23.171922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:23.172532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:23.179496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.179949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.180796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.181230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.251391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:23.259200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-11430fab-4b50-432b-8a64-8e588f5a5362 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1237 microversion: 2.1 time: 0.091847 Jul 15 17:51:23.259781 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 290/588] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:23 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:23.484313 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:23.485617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:23.492165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.492714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.493543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.494060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.623969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:23.631800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-153aa101-d4b1-4817-8cd7-bcae565da763 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.152204 Jul 15 17:51:23.632365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 299/589] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:23 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:23.794697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:23.795322 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:23.801939 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.803562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.804899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.805346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.913208 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:23.913821 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:23.920100 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.920635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:23.921528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:23.922018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.071449 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:24.078016 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=100 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:24.087260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:24.090775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c2ae36d7-ee3d-4af0-84da-723b87e56168 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.300633 Jul 15 17:51:24.092644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c11921e8-727e-48e1-8758-0ce8d3ea46d5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1725 microversion: 2.1 time: 0.182062 Jul 15 17:51:24.092644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 300/590] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:23 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:24.098780 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 291/591] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:23 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:24.277497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:24.278469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:24.287214 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:24.287849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.288675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:24.289115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.289248 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2096666733", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "networks": [{"uuid": "cd2bfcbe-c0b6-4b17-ba6f-cc35996f1c8e"}]}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:24.346259 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] validate_networks() for [('cd2bfcbe-c0b6-4b17-ba6f-cc35996f1c8e', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:51:24.363048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:24.371139 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-bc00a599-aa64-428e-a435-baf70f6fd174 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1311 microversion: 2.1 time: 0.098731 Jul 15 17:51:24.372071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 301/592] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:24 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:24.649207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:24.649938 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:24.656964 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:24.657412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.658256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:24.658685 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.793389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:24.801330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-24bb5749-2dfc-4e41-b0a1-fd5cc5eed91e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.156110 Jul 15 17:51:24.802113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 302/593] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:24 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:24.854705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:51:24.855220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:51:24.855761 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:51:24.856240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:51:24.857355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:51:24.866230 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:24.866781 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.867651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:24.868159 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:24.884893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Getting quotas for project d6aa269b9af048c1860128aa8db2bf28. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:51:24.888727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Getting quotas for user 611f51a2f6434e0ab78559d8b03493df and project d6aa269b9af048c1860128aa8db2bf28. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:51:24.899505 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:51:24.901745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:51:25.038079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-23214587-a3a3-4152-91e9-771487a176cd tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752678 Jul 15 17:51:25.043899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 292/594] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 15 17:51:25.057418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9e258220-9669-4904-8542-bc3cc83dd61e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:25.057418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9e258220-9669-4904-8542-bc3cc83dd61e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:25.109298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9e258220-9669-4904-8542-bc3cc83dd61e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:25.110144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:25.110856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:25.117052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9e258220-9669-4904-8542-bc3cc83dd61e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1219 microversion: 2.1 time: 0.070913 Jul 15 17:51:25.119793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 303/595] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:25 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:25.124617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.125624 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.128021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:25.128583 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.134553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.138409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:25.146287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.147168 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.148519 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.149135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.403365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:25.404475 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:25.412146 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-24ea4a34-7dfc-4599-a89d-04a7b388c8d0 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1725 microversion: 2.1 time: 0.292979 Jul 15 17:51:25.412275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-58d1afe6-da9e-446e-959a-1e7c4916f3f4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.308657 Jul 15 17:51:25.412777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 293/596] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:25 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:25.413053 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 304/597] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:25 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:25.417406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-2a08ddb7-8f23-4690-9ddd-e3becb995369 req-b0ae9ebd-b3ad-4467-a458-8946fd56e88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "name": "network-vif-plugged", "status": "completed", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:25.417813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:25.418486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:25.426295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.427691 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-2a08ddb7-8f23-4690-9ddd-e3becb995369 req-b0ae9ebd-b3ad-4467-a458-8946fd56e88d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.428866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-2a08ddb7-8f23-4690-9ddd-e3becb995369 req-b0ae9ebd-b3ad-4467-a458-8946fd56e88d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.439212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.443951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-2a08ddb7-8f23-4690-9ddd-e3becb995369 req-b0ae9ebd-b3ad-4467-a458-8946fd56e88d service nova] Creating event network-vif-plugged:0dad5793-1312-4eb3-912c-d33ba3dd6b43 for instance 2e8e11f1-2777-4750-9a76-49660282b01d on hv-cinder-83697 Jul 15 17:51:25.445701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.446210 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.449065 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-2a08ddb7-8f23-4690-9ddd-e3becb995369 req-b0ae9ebd-b3ad-4467-a458-8946fd56e88d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035039 Jul 15 17:51:25.449829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 294/598] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:25.611296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:25.618933 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1a9952b9-5d98-4de3-bf01-3d414b3a8b61 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.204828 Jul 15 17:51:25.620145 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 305/599] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:25 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:25.818764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:25.819381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:25.825650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.826152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:25.826934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:25.827395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.022970 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:26.031070 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b0e60084-5b27-4250-847f-ef992bc43824 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.216620 Jul 15 17:51:26.031843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 295/600] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:25 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:26.134051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:26.134916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:26.142705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.143341 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.144430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.144779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.215003 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:26.223944 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-afea654c-3620-4326-b411-50c11b6e0870 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1223 microversion: 2.1 time: 0.093654 Jul 15 17:51:26.224867 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 306/601] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:26 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:26.436913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:26.437758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:26.442924 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:26.443595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:26.451871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.451871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.452491 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.452962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.453289 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.453753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.456878 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.458497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.633653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:26.645394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f40ba1e2-4968-4910-8045-0be22db1e748 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1731 microversion: 2.1 time: 0.207351 Jul 15 17:51:26.646156 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 307/602] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:26 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:26.650936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-d506ca1d-108c-4f57-b829-dfa22f473f6f req-fdf7a79c-2298-4516-b273-45058165fe71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71453995-f196-42f7-beab-0b655b9a9703", "tag": "ffe78c31-4c48-42e7-a184-c48326cc72a7"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:26.666465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d506ca1d-108c-4f57-b829-dfa22f473f6f req-fdf7a79c-2298-4516-b273-45058165fe71 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.668171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d506ca1d-108c-4f57-b829-dfa22f473f6f req-fdf7a79c-2298-4516-b273-45058165fe71 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.680572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-d506ca1d-108c-4f57-b829-dfa22f473f6f req-fdf7a79c-2298-4516-b273-45058165fe71 service nova] Creating event network-changed:ffe78c31-4c48-42e7-a184-c48326cc72a7 for instance 71453995-f196-42f7-beab-0b655b9a9703 on hv-cinder-83697 Jul 15 17:51:26.686504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-d506ca1d-108c-4f57-b829-dfa22f473f6f req-fdf7a79c-2298-4516-b273-45058165fe71 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039343 Jul 15 17:51:26.687229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 308/603] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:26.694696 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:26.695718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:26.702923 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.703378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.704165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.704692 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.845728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:26.853421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0edc9516-d890-45d0-8dfb-9663edcb7c9c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.165226 Jul 15 17:51:26.855308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 309/604] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:26 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:26.859140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:26.859635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:26.867976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.868423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.869234 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:26.869671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:26.954750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-42adef98-f99d-4e32-ab8e-5b167caa6b25 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099665 Jul 15 17:51:26.958551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 310/605] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:51:26 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:27.047851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:27.048931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:27.055371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.056248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.056842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.057284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.191388 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:27.204945 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-43b28bdc-06d4-45f7-afce-f9b93c20a4b9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.774976 Jul 15 17:51:27.206057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 296/606] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:26 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:27.230601 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:27.231103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:27.237814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.238266 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.239041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.239484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.271829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a7f44900-bceb-431f-855b-e261e00ca46b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments/9fecff29-4b2e-4db8-a34e-f7992923e604" status: 200 len: 194 microversion: 2.20 time: 0.045198 Jul 15 17:51:27.272433 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 297/607] 10.222.0.57 () {60 vars in 1453 bytes} [Fri Jul 15 17:51:27 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments/9fecff29-4b2e-4db8-a34e-f7992923e604 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:51:27.277232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:27.277844 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:27.284444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.284924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.286222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.286673 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.337459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:27.345329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d15681b0-4a26-44be-aef3-d9a35b0adedc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.301877 Jul 15 17:51:27.346075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 311/608] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:27 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:27.360054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:27.360552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:27.363499 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:27.366844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.367117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.367898 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.368339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.372035 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bb6722f7-235d-4928-bd57-a81c12177704 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1271 microversion: 2.1 time: 0.098525 Jul 15 17:51:27.374200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 298/609] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:27 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:27.455295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lazy-loading 'services' on Instance uuid a1eee81c-2157-4056-bb4c-8e7a628d96b9 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:27.743077 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-77f007a8-35ce-496a-aea9-1f891258fdd3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments/9fecff29-4b2e-4db8-a34e-f7992923e604" status: 202 len: 0 microversion: 2.20 time: 0.387196 Jul 15 17:51:27.743671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 312/610] 10.222.0.57 () {60 vars in 1456 bytes} [Fri Jul 15 17:51:27 2022] DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments/9fecff29-4b2e-4db8-a34e-f7992923e604 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:51:27.753108 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:27.754027 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:27.760482 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.760993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.761742 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.762177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.791866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2ae90535-3ac4-45b4-b177-31389a5a96b6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043158 Jul 15 17:51:27.792427 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 299/611] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 15 17:51:27 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:51:27.870966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:27.871682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:27.878422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.878859 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:27.879615 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:27.880043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.126398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:28.129776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-78bcb50d-d8c2-406e-9189-96b4faac30d0 req-0827e072-f3f4-448c-80da-fdbe2cc87ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:28.141964 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-78bcb50d-d8c2-406e-9189-96b4faac30d0 req-0827e072-f3f4-448c-80da-fdbe2cc87ca8 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.142410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-78bcb50d-d8c2-406e-9189-96b4faac30d0 req-0827e072-f3f4-448c-80da-fdbe2cc87ca8 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.151228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f1674928-80fb-4466-96a1-5b9ce076394a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.284333 Jul 15 17:51:28.165294 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 313/612] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:27 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:28.169282 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-78bcb50d-d8c2-406e-9189-96b4faac30d0 req-0827e072-f3f4-448c-80da-fdbe2cc87ca8 service nova] Creating event network-changed:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:51:28.174754 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-78bcb50d-d8c2-406e-9189-96b4faac30d0 req-0827e072-f3f4-448c-80da-fdbe2cc87ca8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048927 Jul 15 17:51:28.175422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 300/613] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:28.223812 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:28.224532 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:28.236305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.236921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.237878 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.238311 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.264223 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:28.363463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:28.364466 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:28.371478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.372242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.373226 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.373741 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.395881 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:28.418549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-230cf96b-2e32-4a58-8842-43ffba045b53 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1675 microversion: 2.1 time: 0.199244 Jul 15 17:51:28.422693 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 314/614] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:28 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:28.432405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:28.436267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:28.448033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.450388 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.452796 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.453409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.539726 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:28.547844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-007d989e-c4ee-409c-9682-3e6bc2dd78f6 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1289 microversion: 2.1 time: 0.123728 Jul 15 17:51:28.548295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 315/615] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:28 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:28.767322 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:28.775256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a225ccb4-32b5-4a01-b154-cba92aaec94e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1260 microversion: 2.1 time: 0.416698 Jul 15 17:51:28.776752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 301/616] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:28 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1260 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:28.803583 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:28.805046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:28.811072 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.811512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.812268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:28.812851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:28.844435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-becd9345-a52b-4ba4-a72e-a20ff4e6162e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044873 Jul 15 17:51:28.845218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 316/617] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 15 17:51:28 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:51:29.174233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.175019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:29.181249 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.181699 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.182473 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.182908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.405511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:29.412938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5ffc2a8e-9dc3-4fc6-9b46-8582e5a99a7c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.242573 Jul 15 17:51:29.413485 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 302/618] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:29.437507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.438106 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:29.444468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.444946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.445739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.446174 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.565309 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.565914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:29.572304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.572785 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.573548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.573979 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.579817 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:29.592701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-070bedeb-9256-44de-8dba-b8d40c0d6937 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1652 microversion: 2.1 time: 0.154242 Jul 15 17:51:29.592701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 317/619] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:29.603959 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a9400c24-353f-47ae-9169-4a8ad7f7dfa5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:29.611933 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a9400c24-353f-47ae-9169-4a8ad7f7dfa5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.612455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a9400c24-353f-47ae-9169-4a8ad7f7dfa5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.673516 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a9400c24-353f-47ae-9169-4a8ad7f7dfa5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Going to try to start instance {{(pid=124743) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 15 17:51:29.709601 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:29.717287 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8f57a2ab-7475-4c06-8700-c6daac81300d tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.155957 Jul 15 17:51:29.717840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 303/620] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:29.794333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.794991 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:29.801452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.801892 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.802653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.803070 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.833484 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a9400c24-353f-47ae-9169-4a8ad7f7dfa5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action" status: 202 len: 0 microversion: 2.1 time: 0.232883 Jul 15 17:51:29.834781 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 318/621] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:51:29 2022] POST /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:51:29.842850 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.843472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:29.849683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.852534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.852534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.852534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.940046 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:29.947840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7aa9e130-2947-4b1f-af6a-aaf103e8462a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1444 microversion: 2.1 time: 0.157896 Jul 15 17:51:29.948411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 304/622] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:29.953084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.954092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:29.959901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.960449 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.961284 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:29.961713 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:29.987345 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:29.992185 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3ed14166-ee91-4997-a9d3-ec22796589cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042711 Jul 15 17:51:29.992787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 305/623] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:51:29.994916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7633c45a-296e-48bb-b25a-3f2d6cb190a5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1661 microversion: 2.1 time: 0.156006 Jul 15 17:51:29.995625 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 319/624] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:29.997690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:29.998299 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:30.004366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.004852 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:30.005611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.006045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:30.190730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-002c4f79-c3e5-4c68-802d-965fea4ac9ee req-9cea4bcd-c027-48b0-8a31-3b0e7caeb69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:30.199075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-002c4f79-c3e5-4c68-802d-965fea4ac9ee req-9cea4bcd-c027-48b0-8a31-3b0e7caeb69b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.199592 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-002c4f79-c3e5-4c68-802d-965fea4ac9ee req-9cea4bcd-c027-48b0-8a31-3b0e7caeb69b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:30.212854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-002c4f79-c3e5-4c68-802d-965fea4ac9ee req-9cea4bcd-c027-48b0-8a31-3b0e7caeb69b service nova] Creating event network-changed:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:51:30.218831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-002c4f79-c3e5-4c68-802d-965fea4ac9ee req-9cea4bcd-c027-48b0-8a31-3b0e7caeb69b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Jul 15 17:51:30.219423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 320/625] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:30.329899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:30.337986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-52c18f54-f11a-48da-9c0c-7802abe69c1f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1444 microversion: 2.1 time: 0.343939 Jul 15 17:51:30.338776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 306/626] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:29 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1444 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:30.444629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:30.444629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:30.444629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:30.444629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.444629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:30.445524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.446314 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:30.630900 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:30.647497 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-74d39a3a-9035-42a1-850f-be53361e5b09 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.220950 Jul 15 17:51:30.652670 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 321/627] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:30 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:30.738060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:30.739004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:30.751599 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.752351 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:30.753269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:30.754501 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.004899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:31.007398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:31.014882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:31.015435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.016282 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:31.016759 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.046464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-174f9e9a-cfc4-4635-b8a1-f851224013e8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046175 Jul 15 17:51:31.050286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 322/628] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 15 17:51:30 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 17:51:31.055794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:31.056397 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:31.063059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:31.063504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.064624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:31.064858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.276159 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:31.287399 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6169519c-c842-44f9-8203-62f7eb5e41be tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1661 microversion: 2.1 time: 0.236043 Jul 15 17:51:31.288013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 323/629] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:31 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1661 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:31.330548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:31.339192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6d4c3dae-63f3-4fe1-b2eb-8ce1c48a3313 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.608006 Jul 15 17:51:31.348354 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 307/630] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:30 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:31.666647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:31.667287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:31.674421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:31.678648 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.678648 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:31.678648 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:31.806975 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:31.814427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-567e5b50-7c62-4d54-9dc8-18708d0eb4c4 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.151821 Jul 15 17:51:31.814992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 324/631] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:31 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:32.058254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:32.063800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:32.066054 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.066569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.067368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.067689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.098322 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a0ac4f32-716f-43a9-8449-0106ab1936dc tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044079 Jul 15 17:51:32.099217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 308/632] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 15 17:51:32 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:32.161922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:32.162627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:32.178507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.178507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.178507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.178507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.195511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:51:32.306472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:32.307221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:32.314003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.316111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.316111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.316111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.457566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2bdced20-6ae7-4e3f-a732-24a24e5312e4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 204 len: 0 microversion: 2.20 time: 0.299251 Jul 15 17:51:32.461260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 325/633] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 15 17:51:32 2022] DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 17:51:32.463986 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-60ba461a-ded1-42ac-906a-3083301f00a7 req-c2611c96-5d91-4cfd-85ed-6e1ffd2851a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47130137-71ac-4d17-8e65-378b9c7aec8b", "tag": "ec348d48-b9bb-431c-9aa3-23728e7577e8"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:32.477682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-60ba461a-ded1-42ac-906a-3083301f00a7 req-c2611c96-5d91-4cfd-85ed-6e1ffd2851a7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.478167 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-60ba461a-ded1-42ac-906a-3083301f00a7 req-c2611c96-5d91-4cfd-85ed-6e1ffd2851a7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.490349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-60ba461a-ded1-42ac-906a-3083301f00a7 req-c2611c96-5d91-4cfd-85ed-6e1ffd2851a7 service nova] Creating event network-changed:ec348d48-b9bb-431c-9aa3-23728e7577e8 for instance 47130137-71ac-4d17-8e65-378b9c7aec8b on hv-cinder-83697 Jul 15 17:51:32.495725 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-60ba461a-ded1-42ac-906a-3083301f00a7 req-c2611c96-5d91-4cfd-85ed-6e1ffd2851a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036256 Jul 15 17:51:32.496541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 326/634] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:32.501575 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:32.502541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:32.508891 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.509341 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.510118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.510553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.646464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:32.654203 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d1f86de1-e4b5-4716-8127-ba6dad7751c5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.156691 Jul 15 17:51:32.654770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 327/635] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:32 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:32.659806 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:32.660435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:32.666272 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.666721 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.667494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.667932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.672495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:32.681620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-80d19e25-0035-4f43-afe1-bb988f1c4b48 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1661 microversion: 2.1 time: 0.379608 Jul 15 17:51:32.683432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 309/636] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:32 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1661 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:32.807533 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:32.816318 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:32.817861 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:32.819018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ce5699a0-0787-4290-813c-a2435b4c161b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.163346 Jul 15 17:51:32.819567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 328/637] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:32 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:32.831602 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:32.832279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:32.835379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:32.838952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.839405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.840181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:32.840650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:32.859071 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=100 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:33.006208 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:33.014269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6710637a-20d5-4509-a59d-dc412aa56cec tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.186887 Jul 15 17:51:33.014824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 310/638] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:32 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:33.671879 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:33.673391 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:33.680415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:33.680892 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:33.681666 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:33.682099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:33.699521 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:33.700955 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:33.707916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:33.709375 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:33.710075 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:33.711117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:33.711791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:33.839353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:33.846913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f2575578-f21b-4586-986a-709433928a0e tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.179447 Jul 15 17:51:33.847576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 329/639] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:33 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:33.852070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:33.852801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:33.858630 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:33.859146 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:33.859976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:33.860576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:34.224247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:34.237103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a088ae4a-1db6-4e9b-b84e-2db56366c3b5 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1665 microversion: 2.1 time: 0.541444 Jul 15 17:51:34.238244 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 311/640] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:33 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1665 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:34.244345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:34.246243 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:34.250939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:34.256209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:34.256832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:34.257625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:34.258077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:34.261002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:34.263014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:34.264184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e1785977-0bb8-4950-8cef-6473bcf6fff6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.415595 Jul 15 17:51:34.264764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 330/641] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:33 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:34.764811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:34.774082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e5e1f174-fae7-40a0-9339-4dccf387cd48 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.534610 Jul 15 17:51:34.785338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 312/642] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:34 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:34.864656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:34.865356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:34.872487 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:34.873113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:34.874078 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:34.874704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:34.969526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-1f22dc64-605a-44cb-8e6e-b8917a4318ce req-a335a241-f2bd-488d-9061-6dc40cb2c129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:34.974165 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=4 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:34.975157 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=20 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:34.987590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-1f22dc64-605a-44cb-8e6e-b8917a4318ce req-a335a241-f2bd-488d-9061-6dc40cb2c129 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:34.992059 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-1f22dc64-605a-44cb-8e6e-b8917a4318ce req-a335a241-f2bd-488d-9061-6dc40cb2c129 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:35.005076 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-1f22dc64-605a-44cb-8e6e-b8917a4318ce req-a335a241-f2bd-488d-9061-6dc40cb2c129 service nova] Creating event network-changed:0dad5793-1312-4eb3-912c-d33ba3dd6b43 for instance 2e8e11f1-2777-4750-9a76-49660282b01d on hv-cinder-83697 Jul 15 17:51:35.013937 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-1f22dc64-605a-44cb-8e6e-b8917a4318ce req-a335a241-f2bd-488d-9061-6dc40cb2c129 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050762 Jul 15 17:51:35.015069 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 313/643] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:35.046346 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:35.054738 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-07aac427-df05-401d-b535-6c5378ddd9ad tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.194038 Jul 15 17:51:35.062027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 331/644] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:34 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:35.282323 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:35.283316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:35.291623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:35.292371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:35.293378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:35.293994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:35.306004 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-6da4f684-9f98-4416-ba4b-626b6be9fcc0 req-a41a7198-e555-4077-bad7-291154b7d124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71453995-f196-42f7-beab-0b655b9a9703", "name": "network-vif-plugged", "status": "completed", "tag": "ffe78c31-4c48-42e7-a184-c48326cc72a7"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:35.310271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:35.318685 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6da4f684-9f98-4416-ba4b-626b6be9fcc0 req-a41a7198-e555-4077-bad7-291154b7d124 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:35.324735 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6da4f684-9f98-4416-ba4b-626b6be9fcc0 req-a41a7198-e555-4077-bad7-291154b7d124 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:35.343473 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-6da4f684-9f98-4416-ba4b-626b6be9fcc0 req-a41a7198-e555-4077-bad7-291154b7d124 service nova] Creating event network-vif-plugged:ffe78c31-4c48-42e7-a184-c48326cc72a7 for instance 71453995-f196-42f7-beab-0b655b9a9703 on hv-cinder-83697 Jul 15 17:51:35.348766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-6da4f684-9f98-4416-ba4b-626b6be9fcc0 req-a41a7198-e555-4077-bad7-291154b7d124 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046996 Jul 15 17:51:35.350292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 332/645] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:35.502344 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:35.510837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:35.513343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:35.514539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-787d4ad1-272f-4fb0-8f59-30d5984c3c88 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1721 microversion: 2.20 time: 0.236735 Jul 15 17:51:35.515097 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 314/646] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:35 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:35.794754 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:35.795492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:35.802199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:35.802582 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:35.803337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:35.803762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:35.946907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:35.964026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5df6fe28-ad6a-4607-b6cb-effdb6826f2f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.167515 Jul 15 17:51:35.964026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 333/647] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:35 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:36.076893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:36.078485 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:36.086826 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.087637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:36.089027 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.089653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:36.534415 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:36.535427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:36.542222 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.542670 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:36.543468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.543903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:36.576826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.577275 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:36.577729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lazy-loading 'fault' on Instance uuid a1eee81c-2157-4056-bb4c-8e7a628d96b9 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:36.622285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:36.632048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:36.634646 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:36.635821 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0e42de85-7156-4907-bff7-be76c2f63f13 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1370 microversion: 2.20 time: 0.105390 Jul 15 17:51:36.646968 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 334/648] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:36 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:51:36.656344 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:36.664773 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-eab41ecf-53c4-4aa7-842f-9e0a931883f3 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.595183 Jul 15 17:51:36.674855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 315/649] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:36 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:36.975592 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:36.981742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:36.984943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.985398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:36.986207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:36.986642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.029167 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-dcc67322-8d79-48c9-90b6-425877c82160 req-b712f131-c7c3-4e6d-bb68-e84936c83a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eee81c-2157-4056-bb4c-8e7a628d96b9", "name": "network-vif-deleted", "tag": "9166a97f-a925-40c2-afe2-d0e85818ecf8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:37.039164 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-dcc67322-8d79-48c9-90b6-425877c82160 req-b712f131-c7c3-4e6d-bb68-e84936c83a08 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:37.040095 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-dcc67322-8d79-48c9-90b6-425877c82160 req-b712f131-c7c3-4e6d-bb68-e84936c83a08 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.057603 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-dcc67322-8d79-48c9-90b6-425877c82160 req-b712f131-c7c3-4e6d-bb68-e84936c83a08 service nova] Creating event network-vif-deleted:9166a97f-a925-40c2-afe2-d0e85818ecf8 for instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 on hv-cinder-83697 Jul 15 17:51:37.063391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-dcc67322-8d79-48c9-90b6-425877c82160 req-b712f131-c7c3-4e6d-bb68-e84936c83a08 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038361 Jul 15 17:51:37.064548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 316/650] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:51:37.130383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:37.138469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-100faeb1-a526-415d-aca8-b7e37e7eebd9 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1365 microversion: 2.1 time: 0.166770 Jul 15 17:51:37.139034 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 335/651] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:36 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:37.656870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:37.657591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:37.663957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:37.664417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.665218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:37.666110 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.682997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:37.683898 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:37.691271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:37.695059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.695059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:37.695059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.698378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:37.698834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:37.699290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lazy-loading 'fault' on Instance uuid a1eee81c-2157-4056-bb4c-8e7a628d96b9 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:51:37.741970 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:37.751624 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:37.753700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:37.754888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ea1545bd-f636-4dd7-a9bf-a6fec4e601a2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 200 len: 1370 microversion: 2.20 time: 0.103451 Jul 15 17:51:37.769377 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 317/652] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:37 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 1370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:37.848503 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:37.856715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ef696f37-fde4-411a-a5bc-275c1f116f1f tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.177956 Jul 15 17:51:37.857479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 336/653] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:37 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:38.155929 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:38.156550 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:38.162556 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.163001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.163759 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.164198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.302105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:38.310082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-60ea4082-d7c2-4ac0-bf60-ddbe6acc0db5 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1555 microversion: 2.1 time: 0.158650 Jul 15 17:51:38.310643 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 318/654] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:38 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:38.326775 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:38.327325 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:38.335126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.335575 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.336349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.336826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.420860 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1f545e59-09bd-41f8-93f0-f64d2765b16a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098599 Jul 15 17:51:38.421453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 337/655] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:51:38 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:38.772995 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:38.773678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:38.781185 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.781636 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.782411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.782845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.796627 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] HTTP exception thrown: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Request method failure captured: Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 HTTP/1.1 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agvNcFUBbRXp3k5469Dtd39LqsQ5KrO4OwMfkbYzSRZ8FJhsUk1wgHBuQmywlLBZy-sDiYwU9WILdMxPav9Kaezrn7YYm_HIkAs8cLKdbI5FqjDJ3R5pjbRLNwAvum-qHPKqzbPzzcAHV8GA_vSUN_aKnzuUAq5HqAIDHgyLL5jAi8 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:51:38.798355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14a00a57ce8e46f0b0936cbe9c6ae9d8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}] Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: caab1412244c43adac226cb253a10880 Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:51:38.800015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'a1eee81c-2157-4056-bb4c-8e7a628d96b9'} Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:51:38.800989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:51:38.802450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:51:38.803786 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Returning 404 to user: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:51:38.803786 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fb124d6d-19a6-495b-9db3-6ff1ca2154a9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 404 len: 111 microversion: 2.20 time: 0.030779 Jul 15 17:51:38.803786 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 319/656] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:38 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:51:38.812884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dc8881eb-23a2-42c6-8dcf-e2231ed73a76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '.version_select at 0x7f37d145aca0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:38.873683 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:38.874365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:38.880766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.881225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.882099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:38.882523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:38.904374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dc8881eb-23a2-42c6-8dcf-e2231ed73a76 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726897453" status: 204 len: 0 microversion: 2.20 time: 0.095346 Jul 15 17:51:38.905002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 338/657] 10.222.0.57 () {60 vars in 1258 bytes} [Fri Jul 15 17:51:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726897453 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 17:51:39.021580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:39.029019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a4268435-d54e-40df-841b-4367c8bd2016 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.159172 Jul 15 17:51:39.029585 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 320/658] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:38 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:39.510658 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-3505e82c-5c6e-4fa3-a900-23d0466cbaa1 req-0f0be55f-db3e-45b8-a2d1-50d2999b1c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71453995-f196-42f7-beab-0b655b9a9703", "tag": "ffe78c31-4c48-42e7-a184-c48326cc72a7"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:39.519753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-3505e82c-5c6e-4fa3-a900-23d0466cbaa1 req-0f0be55f-db3e-45b8-a2d1-50d2999b1c29 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:39.520194 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-3505e82c-5c6e-4fa3-a900-23d0466cbaa1 req-0f0be55f-db3e-45b8-a2d1-50d2999b1c29 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:39.532262 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-3505e82c-5c6e-4fa3-a900-23d0466cbaa1 req-0f0be55f-db3e-45b8-a2d1-50d2999b1c29 service nova] Creating event network-changed:ffe78c31-4c48-42e7-a184-c48326cc72a7 for instance 71453995-f196-42f7-beab-0b655b9a9703 on hv-cinder-83697 Jul 15 17:51:39.537303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-3505e82c-5c6e-4fa3-a900-23d0466cbaa1 req-0f0be55f-db3e-45b8-a2d1-50d2999b1c29 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030572 Jul 15 17:51:39.538216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 339/659] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:40.051478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:40.051478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:40.055648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:40.056183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:40.057107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:40.057670 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:40.088634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a57d39c9-306b-492b-ba83-b24406855a19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'create', calling method: .version_select at 0x7f37d14c11f0>, body: {"keypair": {"name": "tempest-keypair-1832225276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvW1EjPupal7NO+rX7c0lbGW2FkGBD468cnxmh9plg4ZeqYIeU3vnnLvghw5tM//XPLVPVS92BZrcjoVOwqCu/8SRW3Je2i7ei70Z91oRYfEsm6qXmWdgkaKq5juOHQJg=="}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:40.104407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-a57d39c9-306b-492b-ba83-b24406855a19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:51:40.111547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-a57d39c9-306b-492b-ba83-b24406855a19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for user caab1412244c43adac226cb253a10880 and project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:51:40.250430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a57d39c9-306b-492b-ba83-b24406855a19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.168183 Jul 15 17:51:40.255456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 340/660] 10.222.0.57 () {62 vars in 1199 bytes} [Fri Jul 15 17:51:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 15 17:51:40.342543 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:40.350398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-10761fbb-01bf-4af7-a1c0-63dad7ebbda5 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.308329 Jul 15 17:51:40.350945 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 321/661] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:40 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:41.349102 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-4e6b45a4-f373-41be-bb5a-f2ea984396c7 req-1dd9d32b-e195-40a4-b8e7-b0b2e03b3c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47130137-71ac-4d17-8e65-378b9c7aec8b", "name": "network-vif-plugged", "status": "completed", "tag": "ec348d48-b9bb-431c-9aa3-23728e7577e8"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:41.358206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-4e6b45a4-f373-41be-bb5a-f2ea984396c7 req-1dd9d32b-e195-40a4-b8e7-b0b2e03b3c57 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:41.358646 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-4e6b45a4-f373-41be-bb5a-f2ea984396c7 req-1dd9d32b-e195-40a4-b8e7-b0b2e03b3c57 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:41.366525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:41.367865 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:41.370060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-4e6b45a4-f373-41be-bb5a-f2ea984396c7 req-1dd9d32b-e195-40a4-b8e7-b0b2e03b3c57 service nova] Creating event network-vif-plugged:ec348d48-b9bb-431c-9aa3-23728e7577e8 for instance 47130137-71ac-4d17-8e65-378b9c7aec8b on hv-cinder-83697 Jul 15 17:51:41.375253 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:41.375469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-4e6b45a4-f373-41be-bb5a-f2ea984396c7 req-1dd9d32b-e195-40a4-b8e7-b0b2e03b3c57 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Jul 15 17:51:41.375689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:41.376398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 341/662] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:41.376530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:41.380087 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:41.529697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:41.537372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a48914f1-6923-4814-9e08-09f52e525627 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.174717 Jul 15 17:51:41.537939 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 322/663] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:41 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:42.407593 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1384932122", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0cf1084-5343-4f44-a2ae-469185090723"}], "security_groups": [{"name": "tempest-securitygroup--1268997125"}], "key_name": "tempest-keypair-1832225276", "user_data": "}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:42.509507 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] validate_networks() for [('d0cf1084-5343-4f44-a2ae-469185090723', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:51:42.555740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:42.556662 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:42.563948 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:42.564326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:42.565143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:42.565575 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:42.696012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:42.703892 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-389a6167-440a-43ac-94d8-2bea251a7df4 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.152187 Jul 15 17:51:42.704463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 323/664] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:42 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:51:42.887632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:51:42.888077 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:51:42.888570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:51:42.889005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:51:42.889433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:51:42.898277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:42.898716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:42.899526 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:42.899952 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:42.916655 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:51:42.921213 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Getting quotas for user caab1412244c43adac226cb253a10880 and project 14a00a57ce8e46f0b0936cbe9c6ae9d8. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:51:42.931841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:51:42.934263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:51:43.037153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-19720dac-5c00-45e0-a01a-c7af2581b904 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.634286 Jul 15 17:51:43.037759 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 342/665] 10.222.0.57 () {62 vars in 1187 bytes} [Fri Jul 15 17:51:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 15 17:51:43.048336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-314c377a-2a9d-4e93-9137-34d04dddae24 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:43.049214 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-314c377a-2a9d-4e93-9137-34d04dddae24 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:43.103893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-314c377a-2a9d-4e93-9137-34d04dddae24 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:43.111699 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-314c377a-2a9d-4e93-9137-34d04dddae24 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:43.113383 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-314c377a-2a9d-4e93-9137-34d04dddae24 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:43.114365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-314c377a-2a9d-4e93-9137-34d04dddae24 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1282 microversion: 2.20 time: 0.069957 Jul 15 17:51:43.115490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 324/666] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:43 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:43.721827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:43.722446 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:43.728932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:43.729379 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:43.730140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:43.730607 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:43.868511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:43.876135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d8ff400f-380c-4a6a-b487-fffac9598d35 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1319 microversion: 2.1 time: 0.158797 Jul 15 17:51:43.877111 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 343/667] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:43 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:44.132539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:44.133169 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:44.143014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:44.143464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:44.144231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:44.144768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:44.211439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:44.220072 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:44.221631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:44.222729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-70d1178a-5be8-41e9-85a8-4ec59a5aa002 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1286 microversion: 2.20 time: 0.094223 Jul 15 17:51:44.223276 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 325/668] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:44 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:44.893830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:44.894554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:44.901433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:44.901874 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:44.902662 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:44.903083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:45.033024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:45.040629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c610cb07-8b39-44e5-a1d8-0afe3d1fa833 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1508 microversion: 2.1 time: 0.150647 Jul 15 17:51:45.041306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 344/669] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:51:44 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:51:45.056993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bff21b18-6d66-402f-9ab7-0614db008383", "device": "/dev/sdb"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:45.058219 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:45.064734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:45.065185 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:45.065955 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:45.066397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:45.240133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:45.244661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:45.248006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:45.248456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:45.249439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:45.249749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:45.325903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:45.335842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:45.337830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:45.338087 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e8d8a6f4-3741-4a40-bd0d-246ad355a6cf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1342 microversion: 2.20 time: 0.101994 Jul 15 17:51:45.338531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 345/670] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:45 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:51:45.891685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a8e02e4d-56fc-480f-97ae-4c9f983d6e00 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "POST /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838536 Jul 15 17:51:45.892460 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 326/671] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:51:45 2022] POST /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:46.361163 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:46.361682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:46.368260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:46.368744 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:46.369518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:46.370149 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:46.509327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:46.518077 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:46.520217 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:46.521367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b23489bd-f8c8-4888-a995-20ebe11f5455 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.164216 Jul 15 17:51:46.521916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 346/672] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:46 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:46.920453 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-9d177bca-fe46-492f-b318-8b4bed4e1a74 req-dd5e3c97-44f8-483b-b23f-95d4f89d9c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:46.929774 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-9d177bca-fe46-492f-b318-8b4bed4e1a74 req-dd5e3c97-44f8-483b-b23f-95d4f89d9c8b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:46.930257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-9d177bca-fe46-492f-b318-8b4bed4e1a74 req-dd5e3c97-44f8-483b-b23f-95d4f89d9c8b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:46.942352 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-9d177bca-fe46-492f-b318-8b4bed4e1a74 req-dd5e3c97-44f8-483b-b23f-95d4f89d9c8b service nova] Creating event network-changed:afcc3cea-0035-4c0b-8b49-8a6746f1c6da for instance 07858177-9488-4d02-8097-a843a7d7ee0a on hv-cinder-83697 Jul 15 17:51:46.949010 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-9d177bca-fe46-492f-b318-8b4bed4e1a74 req-dd5e3c97-44f8-483b-b23f-95d4f89d9c8b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Jul 15 17:51:46.949636 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 327/673] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:47.539430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:47.540033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:47.547320 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:47.547752 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:47.548510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:47.548965 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:47.680472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:47.689149 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:47.690886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:47.692147 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-eee94505-09b9-4992-8b8f-7c4b42b9ba66 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.156679 Jul 15 17:51:47.693205 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 347/674] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:47 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:48.711978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:48.712731 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:48.720496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:48.721105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:48.721908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:48.722384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:48.853038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:48.861021 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:48.862545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:48.863645 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fd495ef4-2a35-48ee-8909-982d9679f41d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.156559 Jul 15 17:51:48.864199 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 328/675] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:48 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:49.882232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:49.882842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:49.889490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:49.889962 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:49.890731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:49.891168 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:50.027649 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:50.035486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:50.037021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:50.038126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a180b074-6453-483d-86bb-259b5160744d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.159954 Jul 15 17:51:50.038670 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 348/676] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:49 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:51.056545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:51.057213 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:51.064191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:51.064702 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:51.065458 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:51.065893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:51.069920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:51.197012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:51.210147 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:51.212956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:51.214750 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9523b6f0-ce94-41cd-a3bc-91d3c7b4eac8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.161982 Jul 15 17:51:51.215737 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 329/677] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:51 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:52.232973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:52.233576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:52.240163 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:52.240629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:52.241405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:52.241837 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:52.369776 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:52.377916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:52.379417 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:52.380517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e778cb9f-3e78-4a15-8030-32bdb79e9632 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.151452 Jul 15 17:51:52.381104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 349/678] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:52 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:53.391142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-67799d47-d6ed-45cf-9eb3-d4233166dc94 req-c0d861f4-6687-478e-9d0a-954f16e1d451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "name": "network-vif-plugged", "status": "completed", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:51:53.401894 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:53.402181 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:53.402181 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:53.402700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-67799d47-d6ed-45cf-9eb3-d4233166dc94 req-c0d861f4-6687-478e-9d0a-954f16e1d451 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:53.402700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-67799d47-d6ed-45cf-9eb3-d4233166dc94 req-c0d861f4-6687-478e-9d0a-954f16e1d451 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:53.403066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:53.404225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=10 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:53.408517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:53.409080 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:53.409848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:53.410276 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:53.412025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-67799d47-d6ed-45cf-9eb3-d4233166dc94 req-c0d861f4-6687-478e-9d0a-954f16e1d451 service nova] Creating event network-vif-plugged:afcc3cea-0035-4c0b-8b49-8a6746f1c6da for instance 07858177-9488-4d02-8097-a843a7d7ee0a on hv-cinder-83697 Jul 15 17:51:53.416951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-67799d47-d6ed-45cf-9eb3-d4233166dc94 req-c0d861f4-6687-478e-9d0a-954f16e1d451 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030134 Jul 15 17:51:53.417550 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 330/679] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:51:53.546535 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:53.550095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:53.558097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:53.559679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:53.560883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-21047b08-be25-410d-b15f-2576570641cd tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.165748 Jul 15 17:51:53.561447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 350/680] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:53 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:54.580108 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:54.580873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:54.587631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:54.588078 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:54.588925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:54.589356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:54.729891 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:54.736320 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:54.738030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:54.739131 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5fdabddd-0c0c-4c60-9073-da51fd800b44 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.163781 Jul 15 17:51:54.739694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 331/681] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:54 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:55.758075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:55.758714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:55.766043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:55.766489 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:55.767250 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:55.767684 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:55.893647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:55.901463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:55.903570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:55.904696 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-12b69dc7-91ac-4398-95a9-6c7fc045a2f6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.151287 Jul 15 17:51:55.905258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 351/682] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:55 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:56.921771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:56.922381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:56.929084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:56.929590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:56.930373 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:56.930910 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:57.062426 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:57.070285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:57.071803 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:57.072932 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2838f54e-821f-4fcc-ade8-ab757f004f26 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.155268 Jul 15 17:51:57.073488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 332/683] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:56 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:58.091629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:58.092286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:58.098997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:58.099447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:58.100217 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:58.100678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:58.230301 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:58.247297 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:58.250212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:58.252718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-074b0b10-fd9b-464b-9112-dd989bd7cd19 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1408 microversion: 2.20 time: 0.165095 Jul 15 17:51:58.253956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 352/684] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:58 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:59.275436 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:59.276083 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:59.283128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:59.283582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:59.284339 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:59.284813 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:59.422919 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:59.431718 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:59.433801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:51:59.434975 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-aa9d2c54-9e27-40d7-9ad7-095e1ea7bec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1599 microversion: 2.20 time: 0.163524 Jul 15 17:51:59.435529 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 333/685] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:51:59 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:51:59.459258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:51:59.459778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:51:59.462088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:59.466850 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:59.467299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:59.468075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:51:59.468514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:51:59.556421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-50a7e625-849b-4e1a-93f3-17b1f6662967 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101019 Jul 15 17:51:59.557254 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 353/686] 10.222.0.57 () {60 vars in 1315 bytes} [Fri Jul 15 17:51:59 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:52:00.769425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-496de1f1-4998-420a-8d4b-a41818b2fa1f req-547a14cb-c747-4200-aa87-fb412f26fcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:00.778589 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-496de1f1-4998-420a-8d4b-a41818b2fa1f req-547a14cb-c747-4200-aa87-fb412f26fcbe service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:00.779108 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-496de1f1-4998-420a-8d4b-a41818b2fa1f req-547a14cb-c747-4200-aa87-fb412f26fcbe service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:00.789869 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-496de1f1-4998-420a-8d4b-a41818b2fa1f req-547a14cb-c747-4200-aa87-fb412f26fcbe service nova] Creating event network-changed:afcc3cea-0035-4c0b-8b49-8a6746f1c6da for instance 07858177-9488-4d02-8097-a843a7d7ee0a on hv-cinder-83697 Jul 15 17:52:00.795341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-496de1f1-4998-420a-8d4b-a41818b2fa1f req-547a14cb-c747-4200-aa87-fb412f26fcbe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029491 Jul 15 17:52:00.795935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 334/687] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:06.860644 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:06.861171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:06.867641 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:06.868081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:06.868918 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:06.869349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:07.122424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lazy-loading 'services' on Instance uuid 47130137-71ac-4d17-8e65-378b9c7aec8b {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:07.324538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4a002eb2-cd13-493d-8d75-5f20360ce7c2 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b/os-volume_attachments/bff21b18-6d66-402f-9ab7-0614db008383" status: 202 len: 0 microversion: 2.1 time: 0.468877 Jul 15 17:52:07.325088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 354/688] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:52:06 2022] DELETE /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b/os-volume_attachments/bff21b18-6d66-402f-9ab7-0614db008383 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:52:09.497307 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:09.497890 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:09.499814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=53 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:09.505053 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:09.510128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:09.510128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:09.510128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:09.532127 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:52:10.000573 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7643a247-93f9-4706-a9c6-2c2e84c25c05 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 204 len: 0 microversion: 2.1 time: 0.507813 Jul 15 17:52:10.001637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 335/689] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:52:09 2022] DELETE /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:52:10.010299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:10.011068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:10.018361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:10.024753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:10.024753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:10.024753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:10.154028 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:10.161356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6ad0f1a1-2f01-4d38-ba7f-93ba16707589 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1514 microversion: 2.1 time: 0.155340 Jul 15 17:52:10.161922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 355/690] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:10 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:11.179283 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:11.179984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:11.186419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:11.186865 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:11.187634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:11.188064 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:11.624406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:11.632143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-702d63fd-7d23-47b9-9212-85fe88bb9b75 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1514 microversion: 2.1 time: 0.457165 Jul 15 17:52:11.632901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 336/691] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:11 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:12.649379 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:12.650610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:12.657869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:12.658316 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:12.659093 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:12.659563 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:12.801001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:12.811457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2f39b916-db9c-476d-9f1d-5cabb0d5fc1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1514 microversion: 2.1 time: 0.165989 Jul 15 17:52:12.812048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 356/692] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:12 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:12.895172 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-377b7f24-f866-4140-8ef3-c9e764548f4d req-04890e95-e3fb-4825-8fd4-70cb1315b1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47130137-71ac-4d17-8e65-378b9c7aec8b", "name": "network-vif-deleted", "tag": "ec348d48-b9bb-431c-9aa3-23728e7577e8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:12.903531 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-377b7f24-f866-4140-8ef3-c9e764548f4d req-04890e95-e3fb-4825-8fd4-70cb1315b1bf service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:12.904048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-377b7f24-f866-4140-8ef3-c9e764548f4d req-04890e95-e3fb-4825-8fd4-70cb1315b1bf service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:12.914723 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-377b7f24-f866-4140-8ef3-c9e764548f4d req-04890e95-e3fb-4825-8fd4-70cb1315b1bf service nova] Creating event network-vif-deleted:ec348d48-b9bb-431c-9aa3-23728e7577e8 for instance 47130137-71ac-4d17-8e65-378b9c7aec8b on hv-cinder-83697 Jul 15 17:52:12.919535 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-377b7f24-f866-4140-8ef3-c9e764548f4d req-04890e95-e3fb-4825-8fd4-70cb1315b1bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028939 Jul 15 17:52:12.920173 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 337/693] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:13.835452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:13.836058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:13.842986 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:13.843431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:13.844192 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:13.844647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:13.875362 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:13.875808 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:13.876515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lazy-loading 'fault' on Instance uuid 47130137-71ac-4d17-8e65-378b9c7aec8b {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:13.922401 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611f51a2f6434e0ab78559d8b03493df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6aa269b9af048c1860128aa8db2bf28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:13.931220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3e065fe5-b121-4189-9bdf-6fe177911910 tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 200 len: 1309 microversion: 2.1 time: 0.099704 Jul 15 17:52:13.931794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 357/694] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:13 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:14.952082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:14.952842 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] [instance: 47130137-71ac-4d17-8e65-378b9c7aec8b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:14.959047 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:14.959498 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:14.960268 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:14.960746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:14.974327 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] HTTP exception thrown: Instance 47130137-71ac-4d17-8e65-378b9c7aec8b could not be found. Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Request method failure captured: Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b HTTP/1.1 Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0ai3OeINDQKrUTXFEM5BwXHLCvkwGTYwIqu2ctCXcnvx7xouU9CyL6CFLF8Yb_NDJs_ws3WU1ntkzKMsPY-UlFy-fd-bCj9yjU8bc19svVFw8S-u2cUfkIYlouy8WRDmUccrOUbSz9muKCmlTjdk3TSxq3dWk471-Jn5hfkViIjEn7c Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d6aa269b9af048c1860128aa8db2bf28 Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1276326184 Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:52:14.975927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6aa269b9af048c1860128aa8db2bf28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6aa269b9af048c1860128aa8db2bf28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6aa269b9af048c1860128aa8db2bf28", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6aa269b9af048c1860128aa8db2bf28"}]}] Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesSnapshotTestJSON-1276326184 Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d6aa269b9af048c1860128aa8db2bf28 Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1276326184 Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesSnapshotTestJSON-1276326184-project Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 611f51a2f6434e0ab78559d8b03493df Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesSnapshotTestJSON-1276326184-project Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 47130137-71ac-4d17-8e65-378b9c7aec8b could not be found. Jul 15 17:52:14.977517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '47130137-71ac-4d17-8e65-378b9c7aec8b'} Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47130137-71ac-4d17-8e65-378b9c7aec8b could not be found. Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:14.978316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47130137-71ac-4d17-8e65-378b9c7aec8b could not be found. Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47130137-71ac-4d17-8e65-378b9c7aec8b could not be found. Jul 15 17:52:14.979536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:14.981290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] Returning 404 to user: Instance 47130137-71ac-4d17-8e65-378b9c7aec8b could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:14.981290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-489516a9-0734-4883-ba58-5ffacc777b1b tempest-VolumesSnapshotTestJSON-1276326184 tempest-VolumesSnapshotTestJSON-1276326184-project] 10.222.0.57 "GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b" status: 404 len: 111 microversion: 2.1 time: 0.029997 Jul 15 17:52:14.981290 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 338/695] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:14 2022] GET /compute/v2.1/servers/47130137-71ac-4d17-8e65-378b9c7aec8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:52:18.496963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:18.497514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:18.504361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:18.504848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:18.506246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:18.506246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:18.586566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'services' on Instance uuid 4a814da1-77ce-4557-9562-1e38c52ba31b {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:18.781907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3df4a872-09d5-4e93-b3af-2c3467efd9a1 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments/d9e4e146-63b7-423f-9675-a09357e35fd2" status: 202 len: 0 microversion: 2.1 time: 0.288629 Jul 15 17:52:18.792263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 358/696] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:52:18 2022] DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments/d9e4e146-63b7-423f-9675-a09357e35fd2 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:52:18.792391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:18.792391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:18.798302 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:18.798758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:18.799529 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:18.799970 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:18.832427 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ca208b52-728a-4dc1-93fc-abfca509a526 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Jul 15 17:52:18.833008 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 339/697] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:18 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:19.845218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:19.846303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:19.852713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:19.853157 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:19.853909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:19.854337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:19.882901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2a5459ec-db01-4fb9-8c95-f981ff8c9898 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Jul 15 17:52:19.883433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 359/698] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:19 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:20.895428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:20.896342 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:20.903081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:20.903526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:20.904311 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:20.904777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:20.935381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a5953503-9f0f-4e96-a10a-dba1d7f94a53 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Jul 15 17:52:20.935943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 340/699] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:20 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:21.947222 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:21.948176 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:21.954701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:21.955156 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:21.955927 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:21.956375 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:21.985290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-af940c5c-0e3d-4794-91f9-c6903dd0bd5a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042036 Jul 15 17:52:21.985840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 360/700] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:21 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:52:22.064111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:22.064797 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:22.070969 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.076724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.076724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.076724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.077030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:22.098027 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:52:22.411148 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-181645f0-8594-4a14-bb09-57d5cc7f5e98 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 204 len: 0 microversion: 2.1 time: 0.350755 Jul 15 17:52:22.411735 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 341/701] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:52:22 2022] DELETE /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:52:22.419713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:22.420325 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:22.426356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.426805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.427572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.428012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.559004 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:22.566620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4541686a-45e7-4a56-a431-7586fa3187ff tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.150781 Jul 15 17:52:22.567175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 361/702] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:22 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:22.836242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:22.838469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:22.843581 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.843747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.844504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.844983 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.877693 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9536b7d0-e12d-474a-bb4f-de51cdabe15b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045278 Jul 15 17:52:22.878711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 342/703] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:22 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:52:22.937586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:22.938087 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:22.943970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.944412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.945202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:22.945672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:22.971795 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:52:23.274028 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-80dcf916-b82d-453a-af73-6d333fd96c67 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 204 len: 0 microversion: 2.1 time: 0.340009 Jul 15 17:52:23.274612 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 362/704] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:52:22 2022] DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:52:23.283212 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:23.283824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:23.290625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:23.291058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:23.291827 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:23.292862 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:23.430007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:23.437639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-529bf464-402a-430d-8bef-94bda9d0af39 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.158289 Jul 15 17:52:23.438194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 343/705] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:23 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:23.584988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:23.585684 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:23.592142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:23.592582 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:23.593386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:23.593816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:23.722550 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:23.730088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e75ede20-56b4-4ae7-82cb-2dd792108517 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.149328 Jul 15 17:52:23.730645 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 363/706] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:23 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:24.455074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:24.455801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:24.462245 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:24.462694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:24.464401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:24.464508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:24.595858 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:24.603453 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-01205efb-e2eb-4362-bcf5-05e6f3ba73b8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.152103 Jul 15 17:52:24.603965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 344/707] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:24 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:24.747465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:24.748096 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:24.754932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:24.755384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:24.756152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:24.756623 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:24.775024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:24.889261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:24.896630 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-45d241a0-718b-4b59-98c1-9bdd4067e8ae tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.153528 Jul 15 17:52:24.897204 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 364/708] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:24 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:25.620487 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:25.621132 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:25.627841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:25.628291 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:25.629095 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:25.629534 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:25.759566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:25.766920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-720b3431-bec4-4e4c-af0b-a57969305b2f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.150319 Jul 15 17:52:25.767476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 345/709] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:25 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:25.913840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:25.914390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:25.921575 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:25.922033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:25.922802 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:25.923240 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:26.050356 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:26.057936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2d7b56d3-69dd-4fe1-9c73-90699a95920d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.148151 Jul 15 17:52:26.058492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 365/710] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:25 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:26.784019 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:26.784679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:26.791477 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:26.792410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:26.793211 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:26.793648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:26.946810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:26.954315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7f4caa12-138f-4a95-8296-5c970ebc1ab7 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.174216 Jul 15 17:52:26.954867 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 346/711] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:26 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:27.128112 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:27.128774 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:27.134920 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:27.135373 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:27.136169 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:27.136622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:27.273512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:27.281600 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-20040395-8e60-407d-be29-d76c85a9195e tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.210710 Jul 15 17:52:27.282172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 366/712] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:27 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:27.972347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:27.972924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:27.980176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:27.980647 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:27.981417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:27.981856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:28.109161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:28.116544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1bd18b3c-b1e6-4c98-8a5c-d89858a85a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.148148 Jul 15 17:52:28.117129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 347/713] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:27 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:28.300120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:28.310704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:28.310704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:28.310704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:28.310704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:28.311057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:28.442353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:28.450703 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-47d0f824-cfb6-4f60-83fc-71bd47bab06b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.154509 Jul 15 17:52:28.451263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 367/714] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:28 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:29.134055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:29.134696 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:29.141185 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:29.141626 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:29.142374 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:29.142804 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:29.273469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:29.281442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d4a772a5-a4b6-48a0-9e25-12fe154dc3cb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.151178 Jul 15 17:52:29.282000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 348/715] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:29 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:29.467612 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:29.468165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:29.474782 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:29.475228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:29.475996 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:29.476424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:29.606313 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:29.613746 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-149f84ef-2ed5-47a1-a43c-54a4ea207c48 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.150062 Jul 15 17:52:29.614311 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 368/716] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:29 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:29.952738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-9f716e4e-68c3-41f3-ad8f-c554a8cc8633 req-3df76b4b-fd9e-4284-ab11-16e69f40a368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "name": "network-vif-unplugged", "status": "completed", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:29.961541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-9f716e4e-68c3-41f3-ad8f-c554a8cc8633 req-3df76b4b-fd9e-4284-ab11-16e69f40a368 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:29.962394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-9f716e4e-68c3-41f3-ad8f-c554a8cc8633 req-3df76b4b-fd9e-4284-ab11-16e69f40a368 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:29.973275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-9f716e4e-68c3-41f3-ad8f-c554a8cc8633 req-3df76b4b-fd9e-4284-ab11-16e69f40a368 service nova] Creating event network-vif-unplugged:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:52:29.978172 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-9f716e4e-68c3-41f3-ad8f-c554a8cc8633 req-3df76b4b-fd9e-4284-ab11-16e69f40a368 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029825 Jul 15 17:52:29.978763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 349/717] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:30.299182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:30.299945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:30.306215 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:30.306657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:30.307413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:30.307844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:30.442509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:30.453250 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ad4e8304-f114-4bb6-94e4-b5221f931f97 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1671 microversion: 2.1 time: 0.157646 Jul 15 17:52:30.454265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 369/718] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:30 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:30.632786 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:30.633609 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:30.640147 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:30.640618 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:30.641397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:30.641839 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:31.008308 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:31.015833 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c84766f5-c060-468c-aced-f5e42283e6b9 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1691 microversion: 2.1 time: 0.387917 Jul 15 17:52:31.016493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 350/719] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:30 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1691 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:31.344740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-97c02c72-fc41-46b3-8725-f9dff6551596 req-ec02f9f2-2c09-4b36-a9de-c04adb2e99f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a814da1-77ce-4557-9562-1e38c52ba31b", "name": "network-vif-deleted", "tag": "2055dc09-2b86-4071-b4b5-0a6ba06884cf"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:31.353852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-97c02c72-fc41-46b3-8725-f9dff6551596 req-ec02f9f2-2c09-4b36-a9de-c04adb2e99f4 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:31.354292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-97c02c72-fc41-46b3-8725-f9dff6551596 req-ec02f9f2-2c09-4b36-a9de-c04adb2e99f4 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:31.365806 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-97c02c72-fc41-46b3-8725-f9dff6551596 req-ec02f9f2-2c09-4b36-a9de-c04adb2e99f4 service nova] Creating event network-vif-deleted:2055dc09-2b86-4071-b4b5-0a6ba06884cf for instance 4a814da1-77ce-4557-9562-1e38c52ba31b on hv-cinder-83697 Jul 15 17:52:31.371088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-97c02c72-fc41-46b3-8725-f9dff6551596 req-ec02f9f2-2c09-4b36-a9de-c04adb2e99f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031417 Jul 15 17:52:31.371768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 370/720] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:31.479043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:31.479043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:31.486447 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:31.486913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:31.488295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:31.488878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:31.619752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:31.629200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8fd52f63-844c-4c4c-b5dd-b5ffb99481fa tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1604 microversion: 2.1 time: 0.160397 Jul 15 17:52:31.629885 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 351/721] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:31 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:32.034379 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:32.035416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:32.043365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:32.043806 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:32.044629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:32.045081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:32.082129 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:32.082612 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:32.083064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'fault' on Instance uuid 4a814da1-77ce-4557-9562-1e38c52ba31b {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:32.129546 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:32.138528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9c11900d-5d38-4fe6-bdd7-53b1db87208b tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 200 len: 1335 microversion: 2.1 time: 0.108481 Jul 15 17:52:32.139575 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 371/722] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:32 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:32.646280 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:32.647160 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:32.653821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:32.654593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:32.655365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:32.655802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:32.690894 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:32.691343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:32.691821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lazy-loading 'fault' on Instance uuid 3134e969-15cb-4cac-a35d-a4543cfa8629 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:32.754906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:32.762679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-98813b88-1b3f-47d5-91c1-e173ff558f3d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 200 len: 1327 microversion: 2.1 time: 0.120196 Jul 15 17:52:32.763256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 352/723] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:32 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:33.155596 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:33.156332 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 4a814da1-77ce-4557-9562-1e38c52ba31b] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:33.163015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:33.163468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:33.164240 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:33.164701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:33.178384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] HTTP exception thrown: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b could not be found. Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Request method failure captured: Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b HTTP/1.1 Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aguD8a54fCYXtt_8xQTS9O_epgiN-k-ksFDGtFTfK1PazWjUqu_K0Ie0Beu1FE2Cuvy-u1Y33ciAtRXlbauO8FGqg1zJ7p58sAwkO_0EjuoIaWc_HKOAbSx8a3Tb4F2dtx8-Gx2bXpyVWoWdRgPnm_nUOEDByLRwt7XvRrV2TUbOZ4 Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:52:33.180029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/882c7039b37f45f8843752b457525d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_882c7039b37f45f8843752b457525d9b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}] Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 8873b1c9f58a4adea93ebe21f5f3263d Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b could not be found. Jul 15 17:52:33.181584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '4a814da1-77ce-4557-9562-1e38c52ba31b'} Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b could not be found. Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:33.182476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b could not be found. Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b could not be found. Jul 15 17:52:33.184502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.185973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Returning 404 to user: Instance 4a814da1-77ce-4557-9562-1e38c52ba31b could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:33.185973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d33a0dee-5d7d-40f1-92b6-e4c349093bf8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b" status: 404 len: 111 microversion: 2.1 time: 0.029799 Jul 15 17:52:33.185973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 372/724] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:33 2022] GET /compute/v2.1/servers/4a814da1-77ce-4557-9562-1e38c52ba31b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:52:33.191116 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6e276715-99dc-4bdc-8efd-4142e86fffee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '.version_select at 0x7f37d14200d0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:33.269187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6e276715-99dc-4bdc-8efd-4142e86fffee tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702794431" status: 202 len: 0 microversion: 2.1 time: 0.081742 Jul 15 17:52:33.269776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 353/725] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 15 17:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702794431 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:52:33.385409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-6b5def89-be38-4d37-bad3-01a38e639ed1 req-9abda3fd-b10d-4091-8fee-958a5ab54009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3134e969-15cb-4cac-a35d-a4543cfa8629", "name": "network-vif-deleted", "tag": "67b8c883-99b9-4bdf-954c-556d88c04747"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:33.394067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6b5def89-be38-4d37-bad3-01a38e639ed1 req-9abda3fd-b10d-4091-8fee-958a5ab54009 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:33.394512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6b5def89-be38-4d37-bad3-01a38e639ed1 req-9abda3fd-b10d-4091-8fee-958a5ab54009 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:33.406073 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-6b5def89-be38-4d37-bad3-01a38e639ed1 req-9abda3fd-b10d-4091-8fee-958a5ab54009 service nova] Creating event network-vif-deleted:67b8c883-99b9-4bdf-954c-556d88c04747 for instance 3134e969-15cb-4cac-a35d-a4543cfa8629 on hv-cinder-83697 Jul 15 17:52:33.410855 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-6b5def89-be38-4d37-bad3-01a38e639ed1 req-9abda3fd-b10d-4091-8fee-958a5ab54009 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029081 Jul 15 17:52:33.411498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 373/726] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:33.780490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:33.781132 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:33.787282 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:33.787731 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:33.788502 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:33.789070 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:33.802703 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] HTTP exception thrown: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Request method failure captured: Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 HTTP/1.1 Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agmijePfpTlSOIO8OUrsQe818659KZ3syw0p0rQCuMgj2FpW95Is_IYT4l4XwnzHAoAsNvBqrFOMH6TSBH-_E1XOCmQZFvjkA75M8xZOoUW_BBqoajQvKkrnkCTwTlhAAK1x6DjTuAjU_fB8Nb6VevGfKuPM0JBgQYd29j4AOvqqxw Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:52:33.804385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbcdf72827044c04842b74194eaf13c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}] Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 5013f4ba5cef44f7bdab6531ec0b0836 Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:52:33.805685 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '3134e969-15cb-4cac-a35d-a4543cfa8629'} Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:33.806465 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:52:33.807584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:33.809166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Returning 404 to user: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:33.809166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-80241155-58ae-4050-9e0b-a2a34211700e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 404 len: 111 microversion: 2.1 time: 0.029874 Jul 15 17:52:33.809166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 354/727] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:33 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:52:33.815773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f0f7aad0-55e1-45a7-bae2-25819527def4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '.version_select at 0x7f37d1458af0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:33.915567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f0f7aad0-55e1-45a7-bae2-25819527def4 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339602627" status: 202 len: 0 microversion: 2.1 time: 0.103866 Jul 15 17:52:33.916390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 374/728] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 15 17:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339602627 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:52:34.619991 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:34.620494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:34.626908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:34.627361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:34.628138 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:34.628580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:34.653872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fcdb0ff7-e1b3-4fbb-bd8d-bbaf92ae2e82 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/ips" status: 200 len: 149 microversion: 2.1 time: 0.099206 Jul 15 17:52:34.654734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 355/729] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:52:34 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:35.036499 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-94a0c275-29fc-4ed9-99b9-f0b56a51c857 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: .version_select at 0x7f37d13f2af0>, body: {"keypair": {"name": "tempest-keypair-736369069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/UtYyJLyjhuYfHGQnx6H/CWPIXnUCJWq8trbfMzC4/c/VwFeCuNLJqXrBk2Yfr3OitxBZj0MdfMXLKV8eUySFIzt8jOC38UqbdQkexksTGrS/oAHw69h2WHaC/AQnThg=="}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:35.051293 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-94a0c275-29fc-4ed9-99b9-f0b56a51c857 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for project fbcdf72827044c04842b74194eaf13c3. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:52:35.055249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-94a0c275-29fc-4ed9-99b9-f0b56a51c857 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for user 5013f4ba5cef44f7bdab6531ec0b0836 and project fbcdf72827044c04842b74194eaf13c3. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:52:35.144294 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-94a0c275-29fc-4ed9-99b9-f0b56a51c857 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111591 Jul 15 17:52:35.145161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 375/730] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:52:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:36.340040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6791bba-0479-499e-968f-fd154f21c864"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:36.341137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:36.347945 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:36.351079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:36.351079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:36.351079 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:36.584066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:36.584762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:36.593279 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:36.593733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:36.594506 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:36.594942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:36.622746 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:52:36.880630 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0ad3ce11-c8fb-4338-b16d-a39704f63859 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "DELETE /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 204 len: 0 microversion: 2.1 time: 0.300554 Jul 15 17:52:36.881575 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 376/731] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:52:36 2022] DELETE /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:52:36.890545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:36.893545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:36.897520 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:36.897967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:36.898733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:36.899169 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:37.034375 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:37.042128 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c4b95fcd-0c3f-4819-acf8-4e0b78afa384 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1508 microversion: 2.1 time: 0.156197 Jul 15 17:52:37.042699 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 377/732] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:36 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:37.117737 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-56cc4113-678a-4a52-9f08-33ede2b1f9fa tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781907 Jul 15 17:52:37.118848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 356/733] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:52:36 2022] POST /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:37.471082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1502678047", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d062dcd-93a8-4bc5-83ff-77d6296f6f1c"}], "security_groups": [{"name": "tempest-securitygroup--1086339503"}], "key_name": "tempest-keypair-736369069", "user_data": "}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:37.477656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:37.570052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] validate_networks() for [('5d062dcd-93a8-4bc5-83ff-77d6296f6f1c', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:52:38.008714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:52:38.009227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:52:38.009639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:52:38.010143 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:52:38.010553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:52:38.020034 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:38.020482 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:38.021329 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:38.021767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:38.039025 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for project fbcdf72827044c04842b74194eaf13c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:52:38.042987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Getting quotas for user 5013f4ba5cef44f7bdab6531ec0b0836 and project fbcdf72827044c04842b74194eaf13c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:52:38.053767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:52:38.056016 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:52:38.060381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:38.061109 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:38.068122 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:38.068122 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:38.069056 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:38.069516 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:38.074214 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:38.201623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:38.209098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-25dd4849-3108-4fb5-a84a-39ac57fe1935 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1508 microversion: 2.1 time: 0.153529 Jul 15 17:52:38.209663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 357/734] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:38 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:38.227989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3c0dcbf8-0254-4b83-9046-17adbfea7a87 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.760865 Jul 15 17:52:38.233739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 378/735] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:52:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:52:38.238958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b44cd6f7-975a-4a0f-a941-5e7138eb9407 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:38.239552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b44cd6f7-975a-4a0f-a941-5e7138eb9407 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:38.302340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b44cd6f7-975a-4a0f-a941-5e7138eb9407 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:38.314490 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b44cd6f7-975a-4a0f-a941-5e7138eb9407 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1237 microversion: 2.1 time: 0.079707 Jul 15 17:52:38.315077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 358/736] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:38 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:39.227298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:39.227853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:39.235078 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:39.235523 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:39.236290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:39.236845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:39.337152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:39.338202 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:39.346371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:39.346990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:39.347772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:39.348387 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:39.408075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:39.417247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ee4931e4-2d9f-449b-afde-3bb138e017c2 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1508 microversion: 2.1 time: 0.194402 Jul 15 17:52:39.418120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 379/737] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:39 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:39.420247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:39.431670 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d468b918-c1c1-4d94-8d3a-af4921337bbb tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1241 microversion: 2.1 time: 0.101626 Jul 15 17:52:39.432379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 359/738] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:39 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:39.993249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-12c2058e-14ed-4f15-84cf-6de9c020bef5 req-569a0c9e-42f4-49a8-baf7-f4568f893e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231a65c1-ce0b-4db4-aded-c8b5cac4b91e", "name": "network-vif-deleted", "tag": "24cc2383-ebc1-48df-a898-c507a890163c"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:40.006548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-12c2058e-14ed-4f15-84cf-6de9c020bef5 req-569a0c9e-42f4-49a8-baf7-f4568f893e9b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:40.006997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-12c2058e-14ed-4f15-84cf-6de9c020bef5 req-569a0c9e-42f4-49a8-baf7-f4568f893e9b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:40.026761 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-12c2058e-14ed-4f15-84cf-6de9c020bef5 req-569a0c9e-42f4-49a8-baf7-f4568f893e9b service nova] Creating event network-vif-deleted:24cc2383-ebc1-48df-a898-c507a890163c for instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e on hv-cinder-83697 Jul 15 17:52:40.032230 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-12c2058e-14ed-4f15-84cf-6de9c020bef5 req-569a0c9e-42f4-49a8-baf7-f4568f893e9b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042653 Jul 15 17:52:40.033379 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 380/739] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:40.435587 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:40.436207 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:40.438577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:40.444028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:40.444492 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:40.445331 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:40.445759 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:40.449526 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:40.451929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:40.457316 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:40.457829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:40.458609 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:40.459045 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:40.513814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:40.531960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:40.532903 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8982f7c4-b122-4d17-aa7d-4014e97b441a tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 200 len: 1292 microversion: 2.1 time: 0.101923 Jul 15 17:52:40.543358 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 360/740] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:40 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:40.543551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5e2464ce-1a56-4436-9468-724976a44d69 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1289 microversion: 2.1 time: 0.095577 Jul 15 17:52:40.543551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 381/741] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:40 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:41.551472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:41.552086 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: 231a65c1-ce0b-4db4-aded-c8b5cac4b91e] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:41.556949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:41.557729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:41.559144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:41.559584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:41.560361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:41.560840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:41.564298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:41.566246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:41.566246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:41.566246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:41.577029 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] HTTP exception thrown: Instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e could not be found. Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Request method failure captured: Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e HTTP/1.1 Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aguD8a54fCYXtt_8xQTS9O_epgiN-k-ksFDGtFTfK1PazWjUqu_K0Ie0Beu1FE2Cuvy-u1Y33ciAtRXlbauO8FGqg1zJ7p58sAwkO_0EjuoIaWc_HKOAbSx8a3Tb4F2dtx8-Gx2bXpyVWoWdRgPnm_nUOEDByLRwt7XvRrV2TUbOZ4 Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:52:41.579050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/882c7039b37f45f8843752b457525d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_882c7039b37f45f8843752b457525d9b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}] Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 8873b1c9f58a4adea93ebe21f5f3263d Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e could not be found. Jul 15 17:52:41.580631 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '231a65c1-ce0b-4db4-aded-c8b5cac4b91e'} Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e could not be found. Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:41.582900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e could not be found. Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e could not be found. Jul 15 17:52:41.584045 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:41.585099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Returning 404 to user: Instance 231a65c1-ce0b-4db4-aded-c8b5cac4b91e could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:41.585099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-53347cb1-ae17-4202-8856-ef4cc88212d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e" status: 404 len: 111 microversion: 2.1 time: 0.033230 Jul 15 17:52:41.585099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 361/742] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:41 2022] GET /compute/v2.1/servers/231a65c1-ce0b-4db4-aded-c8b5cac4b91e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:52:41.590042 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:41.590548 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:41.598332 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:41.598798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:41.599610 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:41.600057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:41.628625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:52:41.740302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:41.749023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9cae7626-c737-484e-8c7e-3b5985553c09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.195959 Jul 15 17:52:41.751085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 382/743] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:41 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:42.056525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f9376d27-36bb-4e27-8047-2eb9dfc0652d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 204 len: 0 microversion: 2.1 time: 0.470980 Jul 15 17:52:42.057157 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 362/744] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:52:41 2022] DELETE /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:52:42.065522 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:42.066164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:42.074337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:42.074337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:42.074337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:42.074337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:42.336734 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:42.345603 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8f9e818f-3a25-4c92-b3df-88efff85d7d8 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.284098 Jul 15 17:52:42.346183 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 383/745] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:42 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:42.767775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:42.768514 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:42.775480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:42.775965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:42.776777 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:42.777191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:42.967596 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-2d0f4ac0-a296-4e60-bd77-601bdf3e102a req-2c6d25a2-183e-436b-b78a-d3acbec1a4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b882983-2a84-4113-be09-1878ffe1b724", "tag": "da682353-ec1c-44eb-aeba-389b20c40cd8"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:42.975694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:42.983246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-2d0f4ac0-a296-4e60-bd77-601bdf3e102a req-2c6d25a2-183e-436b-b78a-d3acbec1a4b1 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:42.983691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-2d0f4ac0-a296-4e60-bd77-601bdf3e102a req-2c6d25a2-183e-436b-b78a-d3acbec1a4b1 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:42.984264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f36847ec-ef22-4231-87da-6283d1120a9b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.220565 Jul 15 17:52:42.985032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 363/746] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:42 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:42.997359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-2d0f4ac0-a296-4e60-bd77-601bdf3e102a req-2c6d25a2-183e-436b-b78a-d3acbec1a4b1 service nova] Creating event network-changed:da682353-ec1c-44eb-aeba-389b20c40cd8 for instance 3b882983-2a84-4113-be09-1878ffe1b724 on hv-cinder-83697 Jul 15 17:52:43.003055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-2d0f4ac0-a296-4e60-bd77-601bdf3e102a req-2c6d25a2-183e-436b-b78a-d3acbec1a4b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118240 Jul 15 17:52:43.003654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 384/747] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:43.362756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:43.363362 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:43.369686 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:43.370141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:43.370938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:43.371374 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:43.506293 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:43.514536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bb787b43-f1a7-4691-8c19-765b5d301645 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.155576 Jul 15 17:52:43.515406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 364/748] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:43 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:44.005511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:44.006212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:44.013182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:44.013632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:44.014521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:44.014958 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:44.018989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:44.145728 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:44.153133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-794a439f-3ac4-4cb4-8c77-f61e6aa32648 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.152095 Jul 15 17:52:44.153715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 385/749] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:43 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:44.531878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:44.532448 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:44.539026 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:44.539477 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:44.540249 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:44.540722 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:44.674419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:44.681924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-222174a4-04b2-4a52-b9e9-7e1a3514b972 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.154023 Jul 15 17:52:44.682541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 365/750] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:44 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:45.170949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:45.171549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:45.178846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:45.179355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:45.180654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:45.180654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:45.333183 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:45.341764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9d27b2f6-71c5-418e-974a-17ded2c850dc tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.175258 Jul 15 17:52:45.342438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 386/751] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:45 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:45.700248 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:45.700890 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:45.707304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:45.707753 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:45.708547 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:45.709051 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:45.845064 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:45.863220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-54bbed13-8600-4780-879e-8fd8f2318ffc tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1520 microversion: 2.1 time: 0.168173 Jul 15 17:52:45.863796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 366/752] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:45 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:46.359518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:46.360199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:46.366843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.367292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.368065 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.368506 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.392704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-a56cf2c4-4217-48d9-a1f3-87ac3ed6a54d req-51fac4b1-5397-44aa-b19b-b0cb25df5c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53d07e0-4b14-4a62-aef7-3bc499d30735", "name": "network-vif-deleted", "tag": "b125e202-f036-4af3-88ec-7fbd51f6ad5e"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:46.403316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-a56cf2c4-4217-48d9-a1f3-87ac3ed6a54d req-51fac4b1-5397-44aa-b19b-b0cb25df5c43 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.403766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-a56cf2c4-4217-48d9-a1f3-87ac3ed6a54d req-51fac4b1-5397-44aa-b19b-b0cb25df5c43 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.416568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-a56cf2c4-4217-48d9-a1f3-87ac3ed6a54d req-51fac4b1-5397-44aa-b19b-b0cb25df5c43 service nova] Creating event network-vif-deleted:b125e202-f036-4af3-88ec-7fbd51f6ad5e for instance d53d07e0-4b14-4a62-aef7-3bc499d30735 on hv-cinder-83697 Jul 15 17:52:46.422292 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-a56cf2c4-4217-48d9-a1f3-87ac3ed6a54d req-51fac4b1-5397-44aa-b19b-b0cb25df5c43 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034400 Jul 15 17:52:46.422751 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 367/753] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:52:46.526969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:46.534847 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4e747002-f6b3-4aa7-9af4-d33997d8d43a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.179154 Jul 15 17:52:46.537561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 387/754] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:46 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:46.776372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6791bba-0479-499e-968f-fd154f21c864"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:46.777574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:46.785022 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.786424 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.786744 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.787801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.871494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Invalid volume: volume a6791bba-0479-499e-968f-fd154f21c864 is already attached to instances: 71453995-f196-42f7-beab-0b655b9a9703 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: POST /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments HTTP/1.1 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 74 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:52:46.873237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {"volumeAttachment": {"volumeId": "a6791bba-0479-499e-968f-fd154f21c864"}} Jul 15 17:52:46.874518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Invalid volume: volume a6791bba-0479-499e-968f-fd154f21c864 is already attached to instances: 71453995-f196-42f7-beab-0b655b9a9703 Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'server_id': '71453995-f196-42f7-beab-0b655b9a9703', 'body': {'volumeAttachment': {'volumeId': 'a6791bba-0479-499e-968f-fd154f21c864'}}} Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a6791bba-0479-499e-968f-fd154f21c864 is already attached to instances: 71453995-f196-42f7-beab-0b655b9a9703 Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:46.875261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a6791bba-0479-499e-968f-fd154f21c864 is already attached to instances: 71453995-f196-42f7-beab-0b655b9a9703 Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:46.876688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a6791bba-0479-499e-968f-fd154f21c864 is already attached to instances: 71453995-f196-42f7-beab-0b655b9a9703 Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 400 to user: Invalid volume: volume a6791bba-0479-499e-968f-fd154f21c864 is already attached to instances: 71453995-f196-42f7-beab-0b655b9a9703 {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d2858cf3-0524-4fcc-a633-f49419868736 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102907 Jul 15 17:52:46.877886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 368/755] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:52:46 2022] POST /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:52:46.882554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:46.883125 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:46.889371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.889960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.890740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.891177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.924807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.924807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.924807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'fault' on Instance uuid d53d07e0-4b14-4a62-aef7-3bc499d30735 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:46.936300 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:46.936832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:46.943916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.944370 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.945176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:46.945613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:46.963530 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:46.971046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-44aa0e5f-b5e5-4604-978c-7aa291eb49c5 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1310 microversion: 2.1 time: 0.094395 Jul 15 17:52:46.971718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 388/756] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:46 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:47.024484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lazy-loading 'services' on Instance uuid 71453995-f196-42f7-beab-0b655b9a9703 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:47.301360 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b02ee509-0689-40b4-9fb5-1ea657105c81 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments/a6791bba-0479-499e-968f-fd154f21c864" status: 202 len: 0 microversion: 2.1 time: 0.369291 Jul 15 17:52:47.427546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 369/757] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:52:46 2022] DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments/a6791bba-0479-499e-968f-fd154f21c864 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:52:47.428450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:47.428450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:47.428450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:47.428450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:47.429110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:47.429110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:47.429110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7c9f2dbe-b2c5-4a95-a169-e53fedf460d8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049458 Jul 15 17:52:47.429110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 389/758] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:47 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:47.545461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:47.546439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:47.551071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:47.551684 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:47.552853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:47.557944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:47.557944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:47.557944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:47.558208 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:47.558610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:47.559376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:47.559810 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:47.578281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f4ef5a10-258b-47b8-94f8-4ef9e027142c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/ips" status: 200 len: 151 microversion: 2.20 time: 0.265145 Jul 15 17:52:47.578858 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 370/759] 10.222.0.57 () {60 vars in 1288 bytes} [Fri Jul 15 17:52:47 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/ips => generated 151 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 15 17:52:47.694061 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:47.703824 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3f91cae2-5f6e-49b8-b4c0-762c21f132b0 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.156439 Jul 15 17:52:47.708443 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 390/760] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:47 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:47.989982 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:47.990712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:47.997793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.001383 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.001383 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.001383 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.030928 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.031431 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.031831 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lazy-loading 'fault' on Instance uuid d53d07e0-4b14-4a62-aef7-3bc499d30735 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:48.073960 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8873b1c9f58a4adea93ebe21f5f3263d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c7039b37f45f8843752b457525d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:48.081392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-acb91ed2-e5cc-421f-ab7d-53722e64892d tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 200 len: 1310 microversion: 2.1 time: 0.095272 Jul 15 17:52:48.092395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 371/761] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:47 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:48.368024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:48.369081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:48.373881 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:48.374586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=10 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:48.378460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.378920 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.379897 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.380500 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.412269 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a902bfb1-b7da-4912-98e9-0bdccebe8571 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Jul 15 17:52:48.412773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 391/762] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:48 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:48.720968 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:48.721510 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:48.724406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:48.727947 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.728486 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.729223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:48.729839 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:48.868404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:48.876614 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2e766118-caa8-46b6-9c43-036dd508e9a1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.159513 Jul 15 17:52:48.877173 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 372/763] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:48 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:49.098348 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:49.098954 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] [instance: d53d07e0-4b14-4a62-aef7-3bc499d30735] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:49.106551 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.107002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.107756 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.108185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.122162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] HTTP exception thrown: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 could not be found. Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Request method failure captured: Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 HTTP/1.1 Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aguD8a54fCYXtt_8xQTS9O_epgiN-k-ksFDGtFTfK1PazWjUqu_K0Ie0Beu1FE2Cuvy-u1Y33ciAtRXlbauO8FGqg1zJ7p58sAwkO_0EjuoIaWc_HKOAbSx8a3Tb4F2dtx8-Gx2bXpyVWoWdRgPnm_nUOEDByLRwt7XvRrV2TUbOZ4 Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:52:49.123779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/882c7039b37f45f8843752b457525d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_882c7039b37f45f8843752b457525d9b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/882c7039b37f45f8843752b457525d9b"}]}] Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 882c7039b37f45f8843752b457525d9b Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1056612890 Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 8873b1c9f58a4adea93ebe21f5f3263d Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1056612890-project Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 could not be found. Jul 15 17:52:49.125416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'd53d07e0-4b14-4a62-aef7-3bc499d30735'} Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 could not be found. Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:49.126485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 could not be found. Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 could not be found. Jul 15 17:52:49.127876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:52:49.135296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] Returning 404 to user: Instance d53d07e0-4b14-4a62-aef7-3bc499d30735 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:49.135296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f8e37809-21dc-47b3-a2f4-80f929de9f20 tempest-ServerRescueNegativeTestJSON-1056612890 tempest-ServerRescueNegativeTestJSON-1056612890-project] 10.222.0.57 "GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735" status: 404 len: 111 microversion: 2.1 time: 0.031411 Jul 15 17:52:49.135296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 392/764] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:49 2022] GET /compute/v2.1/servers/d53d07e0-4b14-4a62-aef7-3bc499d30735 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:52:49.424560 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:49.425604 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:49.432245 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.433559 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.434103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.434540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.461101 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:49.465855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-56aed04e-f13a-4a02-a42a-f403ba82cc97 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045873 Jul 15 17:52:49.473509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 373/765] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:52:49 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:52:49.526952 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:49.527451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:49.533488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.536182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.536182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.536182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.562922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:52:49.868151 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:49.868787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:49.876414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.876939 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.877715 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.878193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.891974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e4e4ac24-deca-4787-85ba-9c58b5e210dd tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 204 len: 0 microversion: 2.1 time: 0.369040 Jul 15 17:52:49.892573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 393/766] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:52:49 2022] DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:52:49.900405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:49.901303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:49.907016 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lazy-loading 'flavor' on Instance uuid 07858177-9488-4d02-8097-a843a7d7ee0a {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:49.908724 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.909777 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:49.910640 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:49.911239 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:50.072971 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:50.081140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1b8fd448-96ff-4c8b-b23b-0b5898fa164e tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.187081 Jul 15 17:52:50.081718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 394/767] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:49 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:50.086609 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:50.087238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:50.093271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:50.093716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:50.094481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:50.094907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:50.230039 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:50.249607 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-10503622-7366-4e46-9101-3bd785c4b679 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1679 microversion: 2.1 time: 0.166613 Jul 15 17:52:50.261259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 395/768] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:50 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:50.466621 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-740d9926-5b4a-403e-9cca-9715bd3c21db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/action" status: 202 len: 0 microversion: 2.20 time: 0.602604 Jul 15 17:52:50.467268 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 374/769] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 15 17:52:49 2022] POST /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:52:50.475525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:50.476142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:50.484132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:50.484585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:50.485388 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:50.485829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:50.632483 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:50.645593 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:50.647114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:50.648296 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dc100768-5ff5-42df-8834-644ee1bc5970 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.176690 Jul 15 17:52:50.648892 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 396/770] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:50 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:51.098439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:51.099145 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:51.105909 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:51.106401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:51.107174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:51.108158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:51.268514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:51.269142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:51.275620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:51.276066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:51.276871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:51.277303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:51.349423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:51.349423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-dbcc695f-721f-43ac-b43d-95cee2b916bf tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.247755 Jul 15 17:52:51.349423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 375/771] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:51 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:51.412534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:51.420995 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-40926ec3-f658-4058-84a3-3202eeb6639c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1679 microversion: 2.1 time: 0.156543 Jul 15 17:52:51.421567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 397/772] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:51 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:51.667686 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:51.668491 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:51.675395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:51.675850 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:51.676932 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:51.677372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:51.947204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:51.959675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:51.963399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:51.965030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0f20d8af-9bce-4d2b-b7c5-2b493504260d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.301954 Jul 15 17:52:51.965712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 376/773] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:51 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:52.171346 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-59591fcd-40d2-46b5-9c3d-00a37d1f87b3 req-f7dc923d-a038-4dfd-bf5b-fd3192529ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b882983-2a84-4113-be09-1878ffe1b724", "name": "network-vif-plugged", "status": "completed", "tag": "da682353-ec1c-44eb-aeba-389b20c40cd8"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:52.181642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-59591fcd-40d2-46b5-9c3d-00a37d1f87b3 req-f7dc923d-a038-4dfd-bf5b-fd3192529ffc service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.182070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-59591fcd-40d2-46b5-9c3d-00a37d1f87b3 req-f7dc923d-a038-4dfd-bf5b-fd3192529ffc service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:52.193830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-59591fcd-40d2-46b5-9c3d-00a37d1f87b3 req-f7dc923d-a038-4dfd-bf5b-fd3192529ffc service nova] Creating event network-vif-plugged:da682353-ec1c-44eb-aeba-389b20c40cd8 for instance 3b882983-2a84-4113-be09-1878ffe1b724 on hv-cinder-83697 Jul 15 17:52:52.198691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-59591fcd-40d2-46b5-9c3d-00a37d1f87b3 req-f7dc923d-a038-4dfd-bf5b-fd3192529ffc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 Jul 15 17:52:52.199284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 398/774] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:52.359905 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:52.360997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:52.366853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.367303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:52.368135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.368577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:52.440280 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:52.441012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:52.447226 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.447672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:52.449016 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.449453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:52.600180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:52.612153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1fc08717-2189-4cbc-8554-e9b526e90890 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1679 microversion: 2.1 time: 0.176575 Jul 15 17:52:52.613906 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 399/775] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:52 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:52:52.713074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:52.720488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-00f66828-fe66-4d83-864b-087288670792 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.364972 Jul 15 17:52:52.721527 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 377/776] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:52 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:52.984616 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:52.985277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:52.991917 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.992494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:52.993991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:52.996513 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:53.147110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:53.155099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:53.164543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:53.167511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ce259b31-1e75-4299-92cd-70852843ba52 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.187498 Jul 15 17:52:53.168509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 400/777] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:52 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:53.390365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-f32b3a28-e1a6-4558-add9-7df170f0d524 req-005d1a73-cf6c-485f-894e-33a8ddcfce1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71453995-f196-42f7-beab-0b655b9a9703", "name": "network-vif-deleted", "tag": "ffe78c31-4c48-42e7-a184-c48326cc72a7"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:53.398660 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-f32b3a28-e1a6-4558-add9-7df170f0d524 req-005d1a73-cf6c-485f-894e-33a8ddcfce1e service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:53.399112 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-f32b3a28-e1a6-4558-add9-7df170f0d524 req-005d1a73-cf6c-485f-894e-33a8ddcfce1e service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:53.414302 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-f32b3a28-e1a6-4558-add9-7df170f0d524 req-005d1a73-cf6c-485f-894e-33a8ddcfce1e service nova] Creating event network-vif-deleted:ffe78c31-4c48-42e7-a184-c48326cc72a7 for instance 71453995-f196-42f7-beab-0b655b9a9703 on hv-cinder-83697 Jul 15 17:52:53.419600 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-f32b3a28-e1a6-4558-add9-7df170f0d524 req-005d1a73-cf6c-485f-894e-33a8ddcfce1e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032762 Jul 15 17:52:53.420527 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 378/778] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:53.632207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:53.633455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:53.641808 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:53.643109 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:53.644127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:53.645341 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:53.671990 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:52:53.731805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:53.740177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:53.742119 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:53.745847 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5961a927-c96b-4237-9a05-cc7b68ce3c39 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1613 microversion: 2.1 time: 0.117949 Jul 15 17:52:53.747154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 401/779] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:53 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:53.763569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:53.767796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:53.769106 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:53.769611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:53.957128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:53.975023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3256e507-cc11-4874-8f67-41b334c4d1d2 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1363 microversion: 2.1 time: 0.241051 Jul 15 17:52:53.976413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 379/780] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:53 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:54.186663 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:54.187202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:54.194446 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:54.194893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:54.195789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:54.196227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:54.374358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:54.390116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:54.391724 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:54.393001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-af05c84d-4d30-4fb6-bb11-c422798994a1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.210404 Jul 15 17:52:54.393658 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 402/781] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:54 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:54.763790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:54.774533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:54.774533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:54.774533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:54.774533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:54.775178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:54.805715 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:54.806158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:54.806605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lazy-loading 'fault' on Instance uuid 71453995-f196-42f7-beab-0b655b9a9703 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:52:54.854626 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:54.862084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-09d18fca-8dd2-43bf-9679-cc042374850d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 200 len: 1331 microversion: 2.1 time: 0.102239 Jul 15 17:52:54.862646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 380/782] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:54 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:54.993932 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:54.995446 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:55.002722 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.003386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.004147 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.004574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.143958 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:55.151556 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c4bbe0e6-8d35-4bbc-9d4c-e2d9e15cd3ff tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1549 microversion: 2.1 time: 0.162131 Jul 15 17:52:55.152240 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 403/783] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:54 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:52:55.168825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:55.169317 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:55.175264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.175711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.176471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.176950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.258297 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-87ad46c6-57f1-4360-ac39-07651253f02f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091000 Jul 15 17:52:55.258998 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 381/784] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:52:55 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:55.411373 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:55.412232 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:55.421241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.421241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.421241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.421241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.676261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:55.684671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:55.686199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:55.687516 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-831826b0-0b5a-4922-93fd-d7574365d647 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.280078 Jul 15 17:52:55.698437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 404/785] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:55 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:55.882412 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:55.883614 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:55.890351 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.893782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.893782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:55.893782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:55.907286 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 HTTP/1.1 Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:52:55.908984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:52:55.910305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '71453995-f196-42f7-beab-0b655b9a9703'} Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:52:55.911098 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:52:55.912281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:52:55.913363 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:52:55.913363 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1556c7c5-55d7-4f72-88da-ae0d1bd78844 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 404 len: 111 microversion: 2.1 time: 0.032484 Jul 15 17:52:55.914824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 382/786] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:52:55 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:52:55.921114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-05b35374-870a-4667-ab80-ef4b18950da3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '.version_select at 0x7f37d14dcd30>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:56.019117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-05b35374-870a-4667-ab80-ef4b18950da3 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066467603" status: 202 len: 0 microversion: 2.1 time: 0.101927 Jul 15 17:52:56.020227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 405/787] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 15 17:52:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066467603 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:52:56.706420 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:56.707372 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:56.716639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:56.720179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:56.720179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:56.720179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:56.800888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-8b242ed9-4ec5-42a0-8597-acf2666ae7db req-a41e7892-0ce6-4306-8f66-d41767d738e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b882983-2a84-4113-be09-1878ffe1b724", "tag": "da682353-ec1c-44eb-aeba-389b20c40cd8"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:56.817154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-8b242ed9-4ec5-42a0-8597-acf2666ae7db req-a41e7892-0ce6-4306-8f66-d41767d738e0 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:56.817606 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-8b242ed9-4ec5-42a0-8597-acf2666ae7db req-a41e7892-0ce6-4306-8f66-d41767d738e0 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:56.845633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-8b242ed9-4ec5-42a0-8597-acf2666ae7db req-a41e7892-0ce6-4306-8f66-d41767d738e0 service nova] Creating event network-changed:da682353-ec1c-44eb-aeba-389b20c40cd8 for instance 3b882983-2a84-4113-be09-1878ffe1b724 on hv-cinder-83697 Jul 15 17:52:56.855428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-8b242ed9-4ec5-42a0-8597-acf2666ae7db req-a41e7892-0ce6-4306-8f66-d41767d738e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222913 Jul 15 17:52:56.855428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 383/788] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:56.902880 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:56.911679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:56.913610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:56.915059 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-458441c4-f36f-4953-8ef4-fa8db07a2e23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.213021 Jul 15 17:52:56.927737 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 406/789] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:56 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:52:56.948002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-54f831bc-1780-4078-8bea-8041188e7178 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: .version_select at 0x7f37d1420040>, body: {"keypair": {"name": "tempest-keypair-738494580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmGygRh/rgEQAZQFkIKCFPPM6OMxrxOd3kCFAqbPUccTqygBHNH43HkVtkRSHFyA3ZHaQ2q1xxRZYws3QGDkW0rGkO9OWlz/hb4LYC4dte/T5umvo0gkX5wGwbGpn846A=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:56.962645 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-54f831bc-1780-4078-8bea-8041188e7178 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:52:56.967485 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-54f831bc-1780-4078-8bea-8041188e7178 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:52:57.069611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-54f831bc-1780-4078-8bea-8041188e7178 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126130 Jul 15 17:52:57.070345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 384/790] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:52:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:52:57.934432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:57.935045 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:57.943422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:57.944132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:57.945184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:57.945710 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:58.117466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:58.126830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:58.128537 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:58.129716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c1759f49-09ee-414b-8694-e6d75acabede tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.199732 Jul 15 17:52:58.130259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 407/791] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:57 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:59.149877 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:52:59.150644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:52:59.158872 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:59.159312 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:59.160105 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:52:59.160518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:52:59.333585 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:59.346313 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:59.348953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:52:59.351062 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2cbb5e89-2afd-45eb-aeea-3c5cc9e5cea1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.206711 Jul 15 17:52:59.352031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 385/792] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:52:59 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:52:59.560645 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1682649012", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9128f0d2-178e-413a-a0d2-d7efa1403a9e"}], "security_groups": [{"name": "tempest-securitygroup--1457560213"}], "key_name": "tempest-keypair-738494580", "user_data": "}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:52:59.669361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] validate_networks() for [('9128f0d2-178e-413a-a0d2-d7efa1403a9e', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:53:00.061284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:53:00.061735 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:53:00.062207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:53:00.062655 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:53:00.063064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:53:00.072109 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:00.072650 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:00.073448 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:00.073878 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:00.091012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:53:00.095521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Getting quotas for user 34e7019b46d743a1b6b0d3315e69053f and project b464e33662344d5a80bdfe413b56b5ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:53:00.106999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:53:00.109292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:53:00.120358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:00.242843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c6447cac-73d9-45cc-b76d-c59f1801d84f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.687480 Jul 15 17:53:00.243795 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 408/793] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:52:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:53:00.254150 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6340b6e5-3cb4-447c-9d35-fc0b56f56bdb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:00.256525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6340b6e5-3cb4-447c-9d35-fc0b56f56bdb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:00.313952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6340b6e5-3cb4-447c-9d35-fc0b56f56bdb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:00.320718 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6340b6e5-3cb4-447c-9d35-fc0b56f56bdb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1241 microversion: 2.1 time: 0.070613 Jul 15 17:53:00.321276 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 386/794] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:00 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:00.370657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:00.371354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:00.381761 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:00.382592 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:00.383489 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:00.383992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:00.526641 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:00.534794 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:00.536303 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:00.537495 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-04bbe1d1-cb43-44e4-a81f-05f8cb2d38ba tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.171621 Jul 15 17:53:00.538051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 409/795] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:00 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:01.339948 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:01.340633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:01.347272 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:01.347715 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:01.348468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:01.348922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:01.414959 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:01.423291 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2e4d8bb6-da30-4dad-a583-c150eff02d41 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1245 microversion: 2.1 time: 0.088753 Jul 15 17:53:01.423772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 387/796] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:01 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:01.555362 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:01.555959 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:01.562572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:01.563016 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:01.563783 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:01.564214 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:01.708895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:01.717750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:01.719255 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:01.720429 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5e6cad13-9299-4875-90f9-64f6604cc8f9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.169063 Jul 15 17:53:01.721018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 410/797] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:01 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:02.440859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:02.441508 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:02.451106 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:02.451568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:02.452640 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:02.452853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:02.533754 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:02.541473 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8dccdb64-39ce-486b-8b6a-ec15ec231f4b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1301 microversion: 2.1 time: 0.104507 Jul 15 17:53:02.542057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 388/798] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:02 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:02.739183 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:02.739807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:02.746818 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:02.751460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:02.751460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:02.751460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:02.881157 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:02.894607 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:02.896143 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:02.898082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6a0777b2-196e-4cf9-a796-8eceffd292e7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.162888 Jul 15 17:53:02.899008 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 411/799] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:02 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:03.563004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:03.564228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:03.571653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:03.572179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:03.573860 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:03.574579 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:03.780965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:03.788484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f7290f60-1906-4bcf-bcc7-04b62f723130 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.233941 Jul 15 17:53:03.789092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 389/800] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:03 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:53:03.921704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:03.929150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:03.929150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:03.929719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:03.930485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:03.930916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:04.100219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:04.110535 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:04.113004 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:04.114225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a43db0dc-48d4-413f-ae11-0c6cd0e986aa tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.196454 Jul 15 17:53:04.114784 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 412/801] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:03 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:04.319074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-d8d11c20-10d1-40f4-99c9-c98c30bf2021 req-ae0d9fa4-69b9-44fe-b66d-2085e7eb9d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f864a1-cda0-4758-9498-465e0c4a5d83", "tag": "4da679fc-62e7-44fe-9105-d7d314d2c6be"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:04.330087 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-d8d11c20-10d1-40f4-99c9-c98c30bf2021 req-ae0d9fa4-69b9-44fe-b66d-2085e7eb9d5a service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:04.330545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-d8d11c20-10d1-40f4-99c9-c98c30bf2021 req-ae0d9fa4-69b9-44fe-b66d-2085e7eb9d5a service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:04.345414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-d8d11c20-10d1-40f4-99c9-c98c30bf2021 req-ae0d9fa4-69b9-44fe-b66d-2085e7eb9d5a service nova] Creating event network-changed:4da679fc-62e7-44fe-9105-d7d314d2c6be for instance e9f864a1-cda0-4758-9498-465e0c4a5d83 on hv-cinder-83697 Jul 15 17:53:04.351607 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-d8d11c20-10d1-40f4-99c9-c98c30bf2021 req-ae0d9fa4-69b9-44fe-b66d-2085e7eb9d5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037302 Jul 15 17:53:04.358883 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 390/802] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:04.805242 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:04.806003 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:04.813004 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:04.813534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:04.814299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:04.814727 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:04.950350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:04.961109 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f359108b-79d7-4c21-91eb-e9244ae7a555 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.159611 Jul 15 17:53:04.961678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 413/803] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:04 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:05.134920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:05.135747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:05.142781 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:05.143356 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:05.144174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:05.144638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:05.299262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:05.308180 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:05.309732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:05.310955 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-baafbb4d-5825-4602-bbe5-0a8da6147535 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.180292 Jul 15 17:53:05.311515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 391/804] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:05 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:05.978518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:05.979803 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:05.986421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:05.986871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:05.987643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:05.988079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:06.118515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:06.126263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2e3d22b8-0b2f-4205-89dc-bf66ef4dfd96 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.152046 Jul 15 17:53:06.126830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 414/805] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:05 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:06.330023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:06.330634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:06.337189 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:06.337638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:06.339063 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:06.339549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:06.481068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:06.488986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:06.490504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:06.491667 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-31d1940b-b776-4102-862e-2c352abb11b7 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.166018 Jul 15 17:53:06.492235 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 392/806] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:06 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:07.141992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:07.142602 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:07.149264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:07.149714 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:07.150585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:07.151621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:07.293864 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:07.301340 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-110f7d2f-b1b2-409c-bb29-94e32e0f5be8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.163135 Jul 15 17:53:07.302005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 415/807] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:07 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:07.510524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:07.511001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:07.517540 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:07.517994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:07.518765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:07.519205 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:07.523263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:07.665807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:07.674747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:07.676312 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:07.677493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d8def4ae-1851-42f3-b1aa-af81fc385ec4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.171577 Jul 15 17:53:07.678051 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 393/808] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:07 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:08.318569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:08.320192 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:08.328239 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:08.328636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:08.329423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:08.329855 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:08.464988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:08.472654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ed510c15-69ae-49ab-9105-6714906df7ae tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.158150 Jul 15 17:53:08.473217 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 416/809] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:08 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:08.695934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:08.696546 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:08.703590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:08.704046 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:08.704864 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:08.705311 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:08.850930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:08.859022 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:08.860582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:08.864965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-17a2f8c0-ae40-4469-a537-2c6d52668e37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.170142 Jul 15 17:53:08.864965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 394/810] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:08 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:09.489573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:09.490256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:09.497349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:09.497802 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:09.498682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:09.499122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:09.630328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:09.637764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f0365aee-1770-40e3-aca2-df0ee5267445 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.152291 Jul 15 17:53:09.638323 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 417/811] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:09 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:09.880084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:09.880806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:09.887269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:09.887713 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:09.888565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:09.889043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:10.060938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:10.069390 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:10.071264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:10.073204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6b851c1b-3c9e-4edf-b642-8a60dfab1817 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.197002 Jul 15 17:53:10.073943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 395/812] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:09 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:10.273259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:10.274108 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=6 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:10.397060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-439ed199-03f0-4a43-b1bb-18618208e803 req-c74662eb-30ca-4dfd-99f3-75ec00a2d5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f864a1-cda0-4758-9498-465e0c4a5d83", "name": "network-vif-plugged", "status": "completed", "tag": "4da679fc-62e7-44fe-9105-d7d314d2c6be"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:10.408749 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-439ed199-03f0-4a43-b1bb-18618208e803 req-c74662eb-30ca-4dfd-99f3-75ec00a2d5f6 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:10.409414 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-439ed199-03f0-4a43-b1bb-18618208e803 req-c74662eb-30ca-4dfd-99f3-75ec00a2d5f6 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:10.423300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-439ed199-03f0-4a43-b1bb-18618208e803 req-c74662eb-30ca-4dfd-99f3-75ec00a2d5f6 service nova] Creating event network-vif-plugged:4da679fc-62e7-44fe-9105-d7d314d2c6be for instance e9f864a1-cda0-4758-9498-465e0c4a5d83 on hv-cinder-83697 Jul 15 17:53:10.428883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-439ed199-03f0-4a43-b1bb-18618208e803 req-c74662eb-30ca-4dfd-99f3-75ec00a2d5f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160153 Jul 15 17:53:10.429478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 418/813] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:10.656379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:10.656379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:10.657666 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=6 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:10.662470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:10.662914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:10.663665 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:10.664091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:10.847745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:10.855906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3e7769b3-37b7-4be3-9926-fc17c489db95 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.204943 Jul 15 17:53:10.856481 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 396/814] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:10 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:11.092622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:11.093525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:11.101309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:11.101768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:11.102545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:11.102985 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:11.237766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:11.245884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:11.247377 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:11.248660 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c15e7184-9989-4cca-b413-b8b7f2f215c8 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.161110 Jul 15 17:53:11.249207 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 419/815] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:11 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:11.873218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:11.873868 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:11.876771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:11.881673 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:11.882121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:11.882887 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:11.883326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:12.026617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:12.033988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d062592a-1a52-4ae6-88a4-7956d5f1e65f tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1367 microversion: 2.1 time: 0.165013 Jul 15 17:53:12.034547 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 397/816] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:11 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:12.267017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:12.267734 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:12.276956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:12.276956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:12.276956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:12.276956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:12.292129 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:12.408723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:12.416252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:12.417788 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:12.418934 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b07294bd-b102-4c35-8306-2dd115747ec2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1745 microversion: 2.20 time: 0.155856 Jul 15 17:53:12.419492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 420/817] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:12 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:13.050551 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:13.051156 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:13.058427 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:13.069409 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:13.069409 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:13.069409 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:13.189330 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:13.196843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b3026082-b132-4e9d-b07c-7c1be0ee730c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1557 microversion: 2.1 time: 0.150117 Jul 15 17:53:13.197393 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 398/818] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:13 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:13.212741 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:13.213236 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:13.219325 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:13.219780 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:13.220549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:13.221014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:13.312261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-403c0599-76f3-40cd-9c57-f20c350b80a1 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103373 Jul 15 17:53:13.312901 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 421/819] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 15 17:53:13 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:13.437336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:13.438154 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:13.444866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:13.445434 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:13.446316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:13.446884 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:13.664144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:13.676016 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:13.678111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:13.679890 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-65c6e842-8253-4ac7-ab40-a5a15d01b42f tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1745 microversion: 2.20 time: 0.246222 Jul 15 17:53:13.680909 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 399/820] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:13 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:14.393360 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-7e7708a9-01d3-4321-9eda-b327615bcbb9 req-2296b1e1-cb61-49e1-86e1-e327f3b496cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f864a1-cda0-4758-9498-465e0c4a5d83", "tag": "4da679fc-62e7-44fe-9105-d7d314d2c6be"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:14.402134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-7e7708a9-01d3-4321-9eda-b327615bcbb9 req-2296b1e1-cb61-49e1-86e1-e327f3b496cd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:14.402661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-7e7708a9-01d3-4321-9eda-b327615bcbb9 req-2296b1e1-cb61-49e1-86e1-e327f3b496cd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:14.414619 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-7e7708a9-01d3-4321-9eda-b327615bcbb9 req-2296b1e1-cb61-49e1-86e1-e327f3b496cd service nova] Creating event network-changed:4da679fc-62e7-44fe-9105-d7d314d2c6be for instance e9f864a1-cda0-4758-9498-465e0c4a5d83 on hv-cinder-83697 Jul 15 17:53:14.419649 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-7e7708a9-01d3-4321-9eda-b327615bcbb9 req-2296b1e1-cb61-49e1-86e1-e327f3b496cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030481 Jul 15 17:53:14.420245 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 422/821] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:14.700353 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:14.701658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:14.708249 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:14.708730 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:14.709691 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:14.710307 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:15.209188 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:15.217747 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:15.219276 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:15.220441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-50208c94-199c-4b9b-99fa-45353b307ec5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1745 microversion: 2.20 time: 0.524738 Jul 15 17:53:15.221219 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 400/822] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:14 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1745 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:16.192435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-44963e4b-d157-4829-878e-c0a8638bacf4 req-0c1357cc-2aab-4aaa-a949-cbdefbfd0374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "name": "network-vif-plugged", "status": "completed", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:16.203350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-44963e4b-d157-4829-878e-c0a8638bacf4 req-0c1357cc-2aab-4aaa-a949-cbdefbfd0374 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:16.203795 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-44963e4b-d157-4829-878e-c0a8638bacf4 req-0c1357cc-2aab-4aaa-a949-cbdefbfd0374 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:16.216221 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-44963e4b-d157-4829-878e-c0a8638bacf4 req-0c1357cc-2aab-4aaa-a949-cbdefbfd0374 service nova] Creating event network-vif-plugged:afcc3cea-0035-4c0b-8b49-8a6746f1c6da for instance 07858177-9488-4d02-8097-a843a7d7ee0a on hv-cinder-83697 Jul 15 17:53:16.221253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-44963e4b-d157-4829-878e-c0a8638bacf4 req-0c1357cc-2aab-4aaa-a949-cbdefbfd0374 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 Jul 15 17:53:16.221945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 423/823] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:16.244825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:16.244825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:16.247210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:16.247660 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:16.248435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:16.248904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:16.430346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:16.440571 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:16.442612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:16.443962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6e8fec52-5992-4a97-a6fa-57d272b677c3 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.208701 Jul 15 17:53:16.444533 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 401/824] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:16 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:17.464230 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:17.464882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:17.472134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:17.472713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:17.473498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:17.473926 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:17.628023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:17.642417 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:17.642417 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:17.643383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-26ba45b6-44c5-4e8d-8731-3ed6b6039b34 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.183542 Jul 15 17:53:17.643960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 424/825] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:17 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:18.663174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:18.663908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:18.672565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:18.673935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:18.674892 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:18.675699 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:18.858667 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:18.867852 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:18.870765 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:18.872274 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-92ca3961-56e2-4272-a537-c3d9efb6e735 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.213354 Jul 15 17:53:18.872895 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 402/826] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:18 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:19.891567 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:19.892284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:19.903109 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:19.903548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:19.904383 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:19.905064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:20.063286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:20.072840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:20.074406 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:20.075682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4350d319-8e01-47e7-a503-e7af0bae804e tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.188091 Jul 15 17:53:20.076494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 425/827] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:19 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:21.096115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:21.097355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:21.105787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:21.106238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:21.107123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:21.107536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:21.283323 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:21.292367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:21.294060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:21.295218 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-347cc9cb-bf01-4fd9-ba0e-2daed5b38bfb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.204012 Jul 15 17:53:21.307062 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 403/828] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:21 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:22.315049 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:22.317261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:22.324826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:22.325579 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:22.326836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:22.327527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:22.477000 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:22.486737 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:22.488959 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:22.490111 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-226f0cef-5f31-45fa-ab76-2a79c20aba62 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.179138 Jul 15 17:53:22.502119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 426/829] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:22 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:23.510920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:23.512404 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:23.519942 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:23.522177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:23.522177 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:23.522601 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:23.723541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:23.732968 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:23.737817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:23.740788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5d415fc0-817c-4275-ab2c-34423b12f2db tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.234843 Jul 15 17:53:23.743014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 404/830] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:23 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:24.763573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:24.764261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:24.773378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:24.773910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:24.775457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:24.775894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:24.930211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:24.938196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:24.939718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:24.940894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-548afcb0-00e8-460c-9fc1-4d9d25138de1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.183747 Jul 15 17:53:24.941464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 427/831] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:24 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:25.958832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:25.959452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:25.966580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:25.967028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:25.967798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:25.968242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:26.114717 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:26.124877 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:26.126699 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:26.128239 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3856e0fb-ab3d-41da-97f8-b9c77162a25b tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1740 microversion: 2.20 time: 0.173142 Jul 15 17:53:26.132965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 405/832] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:25 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:27.147440 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:27.148051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:27.155240 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:27.156260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:27.156656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:27.157091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:27.287411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:27.295906 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:27.297434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:27.298571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-02617035-234f-4a77-8668-8edae9e0d7c4 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1722 microversion: 2.20 time: 0.155094 Jul 15 17:53:27.299119 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 428/833] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:27 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:28.317419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:28.318024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:28.324471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:28.324949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:28.325704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:28.326134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:28.473002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:28.482333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:28.483878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:28.485047 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4e67e755-87ee-4e50-ab7a-e0879bee598d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1722 microversion: 2.20 time: 0.171607 Jul 15 17:53:28.485795 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 406/834] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:28 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:29.503277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:29.503884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:29.511020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:29.511468 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:29.512246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:29.512701 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:29.642262 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:29.651216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:29.652826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:29.654091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-11d49831-8141-4cbb-bce6-c1f7c78cd105 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1725 microversion: 2.20 time: 0.155011 Jul 15 17:53:29.654647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 429/835] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:29 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:29.672007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30c02279-0eb9-46d6-a6ad-520ab26116c8"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:29.673130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:29.679650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:29.680195 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:29.681557 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:29.682210 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:30.164335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:30.217506 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-8dccd54a-05c6-4894-9316-1587a3ea133f req-5df4795f-0783-404a-a925-82d276c6279f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "name": "network-vif-unplugged", "status": "completed", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:30.225787 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-8dccd54a-05c6-4894-9316-1587a3ea133f req-5df4795f-0783-404a-a925-82d276c6279f service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:30.226235 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-8dccd54a-05c6-4894-9316-1587a3ea133f req-5df4795f-0783-404a-a925-82d276c6279f service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:30.238155 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.compute.server_external_events [req-8dccd54a-05c6-4894-9316-1587a3ea133f req-5df4795f-0783-404a-a925-82d276c6279f service nova] Unable to find a host for instance 07858177-9488-4d02-8097-a843a7d7ee0a. Dropping event network-vif-unplugged {{(pid=124743) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 15 17:53:30.239116 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-8dccd54a-05c6-4894-9316-1587a3ea133f req-5df4795f-0783-404a-a925-82d276c6279f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025502 Jul 15 17:53:30.240110 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 430/836] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 15 17:53:30.518102 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6dbfa24f-0277-48eb-8c92-5dc8df420651 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.850173 Jul 15 17:53:30.518814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 407/837] 10.222.0.57 () {62 vars in 1363 bytes} [Fri Jul 15 17:53:29 2022] POST /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-volume_attachments => generated 188 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 15 17:53:30.630824 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:30.631585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:30.635763 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=45 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:30.639299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:30.639816 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:30.640689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:30.641249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:31.209698 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4b03b25e-0873-4c21-93f7-fbbc8794fde2 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-volume_attachments/30c02279-0eb9-46d6-a6ad-520ab26116c8" status: 202 len: 0 microversion: 2.20 time: 0.582878 Jul 15 17:53:31.210375 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 431/838] 10.222.0.57 () {60 vars in 1456 bytes} [Fri Jul 15 17:53:30 2022] DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-volume_attachments/30c02279-0eb9-46d6-a6ad-520ab26116c8 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:53:31.272213 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:31.272814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:31.281343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:31.281343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:31.281343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:31.281343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:31.530882 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [b8d073c8-8a08-42f8-8545-ddf5fda9155d] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 17:53:32.538310 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [b8d073c8-8a08-42f8-8545-ddf5fda9155d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 47126. Jul 15 17:53:32.542732 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4e3105a2-62e4-4915-bf0c-c2ecdc152e5c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "POST /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/action" status: 202 len: 0 microversion: 2.20 time: 1.274493 Jul 15 17:53:32.543348 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 408/839] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 15 17:53:31 2022] POST /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/action => generated 0 bytes in 1276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:53:32.551821 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:32.552531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:32.559659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:32.560321 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:32.561209 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:32.561736 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:32.714757 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:32.724178 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:32.725541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:32.726710 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ab6a26ae-647c-4bd5-a398-0b053d3b3008 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1673 microversion: 2.20 time: 0.179038 Jul 15 17:53:32.727493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 432/840] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:32 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:32.781469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:32.781968 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:32.788360 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:32.788855 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:32.795000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:32.795000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:32.814117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ffad28ee-5f18-4ba7-a010-0415f2eb6bb8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/ips" status: 200 len: 145 microversion: 2.1 time: 0.036760 Jul 15 17:53:32.815010 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 409/841] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:53:32 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:33.748712 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:33.748712 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:33.756544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:33.757458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:33.758445 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:33.759636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:33.902705 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:33.911178 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:33.912713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:33.913876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-694ff4eb-ee1a-47b6-bdf3-c17a194e5035 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1673 microversion: 2.20 time: 0.172262 Jul 15 17:53:33.914432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 433/842] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:33 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:34.505115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "428286be-0704-4d59-b9b6-b834ef8fdeb6"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:34.509413 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:34.513608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:34.514060 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:34.514964 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:34.515799 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:34.937376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:34.938044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:34.944725 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:34.945409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:34.946183 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:34.947359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:35.078571 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:35.088906 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:35.090425 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:35.091562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5bbbf303-a7f4-41c6-a33d-a26cfd3dfa4a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.158318 Jul 15 17:53:35.092128 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 434/843] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:34 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:35.213227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-41269a3a-9eb5-4477-9ff1-e3ff3bd44462 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707276 Jul 15 17:53:35.213227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 410/844] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:53:34 2022] POST /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:36.109390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:36.110095 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:36.119653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:36.120105 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:36.120908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:36.121392 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:36.264996 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:36.274252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:36.275837 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:36.277041 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e84901c2-4944-4e95-98db-0245cd3045ac tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.171549 Jul 15 17:53:36.277594 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 435/845] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:36 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:37.296819 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:37.297520 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:37.304103 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:37.304551 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:37.305355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:37.306363 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:37.480423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:37.489612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:37.491476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:37.501051 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4bd4bafa-e0e1-4c03-9b07-d382c3ea3e12 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.200845 Jul 15 17:53:37.504436 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 411/846] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:37 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:38.525845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:38.526467 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:38.533530 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:38.537890 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:38.539295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:38.539770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:38.679165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:38.681387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:38.687788 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:38.689412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:38.690546 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-597acd67-7ae5-49a9-9c26-2994e6cb2851 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.170323 Jul 15 17:53:38.691104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 436/847] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:38 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:39.708879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:39.709506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:39.716724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:39.717181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:39.717946 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:39.718388 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:39.861072 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:39.870398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:39.872171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:39.884637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ad3692ca-fe56-4611-be28-9f67476b6dec tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.168559 Jul 15 17:53:39.885376 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 412/848] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:39 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:40.892102 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:40.892770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:40.900269 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:40.900757 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:40.901529 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:40.902086 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:41.056204 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:41.065881 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:41.067724 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:41.069009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-b1869927-58e3-48da-9a43-dd589b4b4f4d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.181044 Jul 15 17:53:41.069722 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 437/849] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:40 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:42.087734 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:42.088350 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:42.090832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=34 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:42.095639 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:42.096093 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:42.096886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:42.100958 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:42.229385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:42.238845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:42.240498 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:42.242231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-53160345-bbc1-4f41-befd-aae5731384b1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.158757 Jul 15 17:53:42.248379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 413/850] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:42 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:43.265225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:43.266770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:43.285124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:43.291957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:43.293071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:43.293660 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:43.492404 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:43.504875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:43.506832 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:43.508407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-11eda178-84a8-4c12-af5f-e56e90b40ec1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.251364 Jul 15 17:53:43.510338 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 438/851] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:43 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:43.883470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:43.885769 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:43.898359 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:43.900136 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:43.901745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:43.902901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:43.938865 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lazy-loading 'flavor' on Instance uuid 2e8e11f1-2777-4750-9a76-49660282b01d {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:53:44.310680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-90b947c4-e703-4089-91fa-4ddd2c00c091 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "POST /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d/action" status: 202 len: 0 microversion: 2.1 time: 0.435512 Jul 15 17:53:44.312676 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 414/852] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:53:43 2022] POST /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:53:44.324737 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:44.326589 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:44.336495 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:44.338222 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:44.341758 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:44.342479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:44.523770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:44.528411 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:44.529136 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:44.532056 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ad6cfbd6-7994-46d9-aac3-38dd221af706 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.214012 Jul 15 17:53:44.532846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 439/853] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:44 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:44.535227 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:44.535665 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:44.536539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:44.536996 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:44.730637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:44.738914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:44.741212 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:44.741571 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a735aa83-9a1b-460f-aa4d-5811701005d1 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.217973 Jul 15 17:53:44.742128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 415/854] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:44 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:45.550916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:45.553378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:45.559930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:45.560381 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:45.561188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:45.561626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:45.700378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:45.708230 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-15b79538-5464-426e-ad3f-6ee5052c1860 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.162073 Jul 15 17:53:45.708827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 440/855] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:45 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:45.760358 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:45.761074 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:45.767541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:45.767995 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:45.768787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:45.769222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:45.907574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:45.916769 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:45.918463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:45.919674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b9f75b64-88d7-4d05-b660-9d8add3141d5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.163390 Jul 15 17:53:45.920225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 416/856] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:45 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:46.726235 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:46.726847 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:46.734150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:46.734597 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:46.735353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:46.735785 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:46.875688 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:46.884199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dce8a10c-03d4-4ff1-ab7a-b0d5913474bc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.161495 Jul 15 17:53:46.884739 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 441/857] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:46 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:46.938662 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:46.939366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:46.945882 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:46.946859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:46.947630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:46.948068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:47.085704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:47.094380 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:47.095947 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:47.097160 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8494fe9b-8ecc-4b95-bf4c-3168e8d2ed37 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.162707 Jul 15 17:53:47.097920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 417/858] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:46 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:47.902042 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:47.902664 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:47.909080 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:47.909521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:47.910295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:47.910717 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:48.042875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:48.050769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5a8e8d6e-eaa8-4cbd-b7de-f8dd17e29eeb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.153207 Jul 15 17:53:48.051451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 442/859] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:47 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:48.115123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:48.115758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:48.122780 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:48.123232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:48.123999 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:48.124439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:48.256398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:48.265162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:48.266663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:48.267810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-eb728a64-9f00-4562-bc19-564bcfd80d23 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.156552 Jul 15 17:53:48.268368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 418/860] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:48 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:49.068488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:49.069254 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:49.077172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.077627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.078412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.078849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.115987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:49.117031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:49.127319 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.127783 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.128575 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.129220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.155728 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:49.160451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1e6f4f45-f63e-47d9-9c1c-e9e75f6ff451 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048400 Jul 15 17:53:49.167194 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 419/861] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:53:49 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:53:49.172412 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:49.172938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:49.179114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.179568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.180899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.181353 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.211644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-52db226b-9c47-44a8-b0c9-fe4189b3aeee tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/428286be-0704-4d59-b9b6-b834ef8fdeb6" status: 200 len: 194 microversion: 2.1 time: 0.043068 Jul 15 17:53:49.212627 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 420/862] 10.222.0.57 () {58 vars in 1412 bytes} [Fri Jul 15 17:53:49 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/428286be-0704-4d59-b9b6-b834ef8fdeb6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:53:49.230607 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:49.239501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2603b79f-2f34-4abb-bf11-3e6270609e37 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.174873 Jul 15 17:53:49.240188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 443/863] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:49 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:49.286193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:49.286918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:49.293591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.294042 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.294811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:49.295931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:49.441927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:49.451334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:49.452929 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:49.454186 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4c70f18c-6835-43cd-8c26-6c3ef97ab460 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.171974 Jul 15 17:53:49.454794 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 421/864] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:49 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:50.257243 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:50.257936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:50.265347 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:50.268708 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:50.268708 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:50.268708 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:50.411669 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:50.419678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-21e5eaa0-b492-4b55-b500-782da4e04dd0 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.166321 Jul 15 17:53:50.422744 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 444/865] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:50 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:50.473673 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:50.474279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:50.481519 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:50.481964 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:50.482710 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:50.483139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:50.613699 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:50.622111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:50.623675 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:50.625113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-27e1b61c-490c-43d7-b49e-29ab91273ba9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.155055 Jul 15 17:53:50.625669 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 422/866] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:50 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:53:51.339355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "354e3312-038b-483d-bf1e-be3386c3abdf"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:51.340574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:51.347440 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:51.347971 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:51.348650 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:51.349083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:51.438642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:51.439291 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:51.446663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:51.447801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:51.449113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:51.449566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:51.595293 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:51.603535 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1310e9f8-b808-4ffc-a8eb-111ae91d5cb3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.168811 Jul 15 17:53:51.604102 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 423/867] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:51 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:53:51.644277 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:51.644935 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:51.651170 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:51.652303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:51.652611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:51.653050 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:51.796236 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:51.804574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:51.806206 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:51.807453 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c2ea4516-c4a1-4985-9720-a645b8bdb68a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.168953 Jul 15 17:53:51.808005 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 424/868] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:51 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:51.985117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c56da008-f312-4d4e-adc4-ba47ade99946 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "POST /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650187 Jul 15 17:53:51.989656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 445/869] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:53:51 2022] POST /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:52.445075 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-0f5c6bba-fc4b-4615-94c2-8c00fb6aa9cc req-853dddea-9316-4087-89fb-5eb5cf189866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "name": "network-vif-plugged", "status": "completed", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:53:52.453216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-0f5c6bba-fc4b-4615-94c2-8c00fb6aa9cc req-853dddea-9316-4087-89fb-5eb5cf189866 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:52.453652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-0f5c6bba-fc4b-4615-94c2-8c00fb6aa9cc req-853dddea-9316-4087-89fb-5eb5cf189866 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:52.466002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-0f5c6bba-fc4b-4615-94c2-8c00fb6aa9cc req-853dddea-9316-4087-89fb-5eb5cf189866 service nova] Creating event network-vif-plugged:afcc3cea-0035-4c0b-8b49-8a6746f1c6da for instance 07858177-9488-4d02-8097-a843a7d7ee0a on hv-cinder-83697 Jul 15 17:53:52.471428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-0f5c6bba-fc4b-4615-94c2-8c00fb6aa9cc req-853dddea-9316-4087-89fb-5eb5cf189866 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Jul 15 17:53:52.472446 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 425/870] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:52.621048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:52.621747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:52.628828 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:52.629316 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:52.630026 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:52.630458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:52.777980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:52.785510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-bd682ac3-30ca-4492-b217-411593606f7c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.169382 Jul 15 17:53:52.786491 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 446/871] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:52 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:52.826983 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:52.827684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:52.834677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:52.835925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:52.837633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:52.838269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:52.990439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:53.005443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:53.006973 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:53.008810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-46bb2c54-eb08-44d4-8ea6-ceaaa2538209 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.185557 Jul 15 17:53:53.009305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 426/872] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:52 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:53.803790 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:53.804394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:53.811944 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:53.812386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:53.813191 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:53.813640 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:53.954743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:53.963099 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e1a7a94f-a62b-4eb7-99f1-8d086ea2817b tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.163297 Jul 15 17:53:53.963671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 447/873] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:53 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:54.027333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:54.027992 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:54.034531 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:54.034974 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:54.035728 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:54.036158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:54.170260 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:54.178262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:54.179750 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:54.180920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4a7775ff-0c04-48e1-9c26-facce574d9cb tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.158150 Jul 15 17:53:54.181537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 427/874] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:54 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:54.979585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:54.980185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:54.986565 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:54.987008 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:54.987765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:54.988188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.121091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:55.131146 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1d14d76d-66ef-4a5e-a3ae-10ea907c7f90 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.155753 Jul 15 17:53:55.131848 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 448/875] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:54 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:55.200049 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:55.200774 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:55.207686 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.208123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.208900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.209441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.344463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:55.354835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:55.356570 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:55.357834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ea4bd46e-a0e6-4352-905e-47c3f5a356b5 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1731 microversion: 2.20 time: 0.162458 Jul 15 17:53:55.370146 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 428/876] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:55 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:55.462331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:55.463304 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:55.469343 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.469790 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.470546 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.470978 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.502094 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-16759cad-3496-4af3-ac3d-18e6889869d1 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043514 Jul 15 17:53:55.502666 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 449/877] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:53:55 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:55.648811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:55.649301 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:55.655336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.655782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.656544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.657020 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.687380 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8a57c315-76cf-40e9-856f-7cc50ab3e82f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/428286be-0704-4d59-b9b6-b834ef8fdeb6" status: 200 len: 194 microversion: 2.1 time: 0.042497 Jul 15 17:53:55.687967 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 429/878] 10.222.0.57 () {58 vars in 1412 bytes} [Fri Jul 15 17:53:55 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/428286be-0704-4d59-b9b6-b834ef8fdeb6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:53:55.698305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:55.698880 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:55.705079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.705628 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.706405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:55.706845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:55.796455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lazy-loading 'services' on Instance uuid 3b882983-2a84-4113-be09-1878ffe1b724 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:53:56.105894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cd01e5ad-4dea-4e29-96e8-275b94bdec7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/428286be-0704-4d59-b9b6-b834ef8fdeb6" status: 202 len: 0 microversion: 2.1 time: 0.412010 Jul 15 17:53:56.106631 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 450/879] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:53:55 2022] DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/428286be-0704-4d59-b9b6-b834ef8fdeb6 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:53:56.148630 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:56.150591 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:56.159472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:56.159922 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:56.160736 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:56.161181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:56.311043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:56.318582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c8d3966a-0a66-40e7-969b-42b7e3fc52c3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.173830 Jul 15 17:53:56.319135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 430/880] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:56 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:56.377555 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:56.378291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:56.384943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:56.385393 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:56.386165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:56.386602 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:56.549874 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:56.676279 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:56.684764 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:56.686305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:56.687559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-defe9025-338f-4ffc-84e4-60b32097a61c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1718 microversion: 2.20 time: 0.314535 Jul 15 17:53:56.688115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 451/881] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:53:56 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1718 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:53:57.336806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:57.337430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:57.343923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:57.344409 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:57.345469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:57.345907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:57.492484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:57.500918 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7d42070e-fec8-4e4d-b311-07b974e471c4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.168671 Jul 15 17:53:57.501511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 431/882] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:57 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:58.315519 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:58.316077 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:58.323949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:58.324934 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:58.325626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:58.325773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:58.355554 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3a418dd0-3ffc-42ba-9e42-5929de65daf9 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/354e3312-038b-483d-bf1e-be3386c3abdf" status: 200 len: 194 microversion: 2.1 time: 0.044314 Jul 15 17:53:58.356146 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 452/883] 10.222.0.57 () {58 vars in 1412 bytes} [Fri Jul 15 17:53:58 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/354e3312-038b-483d-bf1e-be3386c3abdf => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:53:58.365979 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:58.366525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:58.373013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:58.373467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:58.374245 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:58.374937 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:58.463914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lazy-loading 'services' on Instance uuid 3b882983-2a84-4113-be09-1878ffe1b724 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:53:58.519702 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:58.520320 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:58.527306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:58.527758 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:58.528528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:58.529172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:58.672489 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:58.680894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-08f8e08b-3b3d-476e-b78d-d5eb076d3df9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.164714 Jul 15 17:53:58.681698 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 453/884] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:58 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:53:58.820435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-74f90246-3982-4a79-bd06-f3c13a90a9b6 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/354e3312-038b-483d-bf1e-be3386c3abdf" status: 202 len: 0 microversion: 2.1 time: 0.458196 Jul 15 17:53:58.821689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 432/885] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:53:58 2022] DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments/354e3312-038b-483d-bf1e-be3386c3abdf => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:53:59.699175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:53:59.705241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:53:59.707224 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:59.709135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:59.710117 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:53:59.710969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:53:59.858100 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:53:59.869881 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2303e82c-14a7-440d-91af-522b47900f9e tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.173503 Jul 15 17:53:59.870865 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 454/886] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:53:59 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:00.888937 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:00.889641 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:00.895944 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:00.896379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:00.897176 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:00.897617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:01.176291 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:01.184580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e81df32f-1f4b-46cd-8763-397a962e1c0c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.300379 Jul 15 17:54:01.185166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 433/887] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:00 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:01.392509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:01.394393 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:01.395853 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=48 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:01.405320 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:01.412916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:01.412916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:01.412916 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:01.433121 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0acb9626-6039-42b8-a429-27aaa934c332 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/ips" status: 200 len: 150 microversion: 2.1 time: 0.044464 Jul 15 17:54:01.435100 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 455/888] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 15 17:54:01 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:02.203560 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:02.204181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:02.212238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.222784 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.223933 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.225611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.309150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:02.310268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:02.317844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.318300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.319084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.319521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.352718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-750aaef3-97bc-4e01-80b7-9d7fc2fa0808 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048599 Jul 15 17:54:02.354286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 456/889] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:54:02 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 17:54:02.432665 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:02.442205 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9f84497e-8eed-4e11-a725-e2a9f7e6b228 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1509 microversion: 2.1 time: 0.242792 Jul 15 17:54:02.443055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 434/890] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:02 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:02.458873 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:02.460029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:02.473394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.473394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.473394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.473394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.502041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:02.503037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:02.510447 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.510906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.511684 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.512119 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.544758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4b6f91b7-0e01-4010-8744-944e92880e86 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046755 Jul 15 17:54:02.545619 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 435/891] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:54:02 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 15 17:54:02.607720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:02.608221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:02.614585 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.615033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.619367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.619367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.634817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:02.645617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:54:02.760197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1790ed60-dd7d-4405-b7d0-874d03a16d2c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "POST /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d/action" status: 202 len: 0 microversion: 2.1 time: 0.305087 Jul 15 17:54:02.764691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 457/892] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:54:02 2022] POST /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:54:02.771426 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:02.772350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:02.779907 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.780561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:02.781553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:02.782144 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:03.079333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8b6c669b-7fb9-4558-a9bc-d89b2e54f292 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 204 len: 0 microversion: 2.1 time: 0.474617 Jul 15 17:54:03.079949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 436/893] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:02 2022] DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:54:03.089822 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:03.090828 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:03.097945 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:03.098395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:03.099180 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:03.100182 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:03.311652 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:03.320899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-40a4a182-9df3-40f1-a0a1-ca9ca0a55bd6 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1517 microversion: 2.1 time: 0.554462 Jul 15 17:54:03.321481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 458/894] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:02 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1517 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:03.348260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d61a1bb2-7584-4e8f-94a4-c31d2a11c66f"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:03.349404 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:03.356159 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:03.356620 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:03.357419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:03.357856 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:03.388320 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:03.399370 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5d3f3c20-11ce-4f11-ba79-3ad6ea39b839 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1673 microversion: 2.1 time: 0.314867 Jul 15 17:54:03.400153 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 437/895] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:03 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1673 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:04.337993 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:04.338661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:04.344956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:04.345414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:04.346197 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:04.346637 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:04.579354 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:04.587680 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-385ee99b-6c23-4e22-9185-f91ee8dcdf96 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1517 microversion: 2.1 time: 0.253431 Jul 15 17:54:04.588266 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 438/896] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:04 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:04.593121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:04.593787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:04.599683 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:04.600141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:04.600961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:04.601628 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:04.810279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:04.819232 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-30451ae7-2f31-4c4e-aff9-b378218bfc09 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1673 microversion: 2.1 time: 0.229608 Jul 15 17:54:04.821430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 439/897] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:04 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:04.826387 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-8de1d7bb-f1c2-4ca7-81f7-3fc605eefb14 req-2a5f7aa6-60db-4ce4-80d5-f548c662b415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "name": "network-vif-unplugged", "status": "completed", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:04.837040 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-8de1d7bb-f1c2-4ca7-81f7-3fc605eefb14 req-2a5f7aa6-60db-4ce4-80d5-f548c662b415 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:04.838222 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-8de1d7bb-f1c2-4ca7-81f7-3fc605eefb14 req-2a5f7aa6-60db-4ce4-80d5-f548c662b415 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:04.854807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.compute.server_external_events [req-8de1d7bb-f1c2-4ca7-81f7-3fc605eefb14 req-2a5f7aa6-60db-4ce4-80d5-f548c662b415 service nova] Unable to find a host for instance 2e8e11f1-2777-4750-9a76-49660282b01d. Dropping event network-vif-unplugged {{(pid=124745) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 15 17:54:04.855943 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-8de1d7bb-f1c2-4ca7-81f7-3fc605eefb14 req-2a5f7aa6-60db-4ce4-80d5-f548c662b415 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033446 Jul 15 17:54:04.857326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 440/898] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 15 17:54:05.606966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5ef4a6e1-2795-4c3a-a844-1f53c356a495 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "POST /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.251804 Jul 15 17:54:05.609442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:05.614736 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 459/899] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:54:03 2022] POST /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments => generated 194 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:54:05.615657 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:05.626525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:05.627824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:05.627824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:05.628211 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:05.840982 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:05.842052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:05.849253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:05.850043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:05.852695 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:05.853336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:05.975072 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:06.011723 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:06.015138 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f78813a2-9dbb-4e39-a52f-dd60d241ae7a tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1673 microversion: 2.1 time: 0.180017 Jul 15 17:54:06.016419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 460/900] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:05 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:06.018588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-35e0375a-6a8b-4ece-9465-3c139836f10c tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1519 microversion: 2.1 time: 0.412703 Jul 15 17:54:06.019443 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 441/901] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:05 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:06.764810 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-baa957cc-5ed4-4593-a892-385a3d1fdc32 req-365604ec-e862-4efa-a334-27a512933b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b882983-2a84-4113-be09-1878ffe1b724", "name": "network-vif-deleted", "tag": "da682353-ec1c-44eb-aeba-389b20c40cd8"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:06.774462 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-baa957cc-5ed4-4593-a892-385a3d1fdc32 req-365604ec-e862-4efa-a334-27a512933b6c service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:06.776140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-baa957cc-5ed4-4593-a892-385a3d1fdc32 req-365604ec-e862-4efa-a334-27a512933b6c service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:06.796555 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-baa957cc-5ed4-4593-a892-385a3d1fdc32 req-365604ec-e862-4efa-a334-27a512933b6c service nova] Creating event network-vif-deleted:da682353-ec1c-44eb-aeba-389b20c40cd8 for instance 3b882983-2a84-4113-be09-1878ffe1b724 on hv-cinder-83697 Jul 15 17:54:06.802089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-baa957cc-5ed4-4593-a892-385a3d1fdc32 req-365604ec-e862-4efa-a334-27a512933b6c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043464 Jul 15 17:54:06.803014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 461/902] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:07.042177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:07.042456 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:07.044458 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:07.046839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:07.074005 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:07.074721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:07.075754 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:07.077970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:07.078354 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:07.079789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:07.085405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:07.086663 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:07.197085 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013f4ba5cef44f7bdab6531ec0b0836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbcdf72827044c04842b74194eaf13c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:07.207962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d9608a8a-6ead-409a-b394-df6c993ea65f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 200 len: 1322 microversion: 2.1 time: 0.175168 Jul 15 17:54:07.208845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 442/903] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:07 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:07.359975 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:07.369082 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-de2eb879-7b25-45d4-affa-c9b478b107dc tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.334795 Jul 15 17:54:07.374564 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 462/904] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:07 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:08.239561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:08.245884 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:08.254899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:08.255608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:08.256580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:08.257132 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:08.272694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] HTTP exception thrown: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Request method failure captured: Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 HTTP/1.1 Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agmijePfpTlSOIO8OUrsQe818659KZ3syw0p0rQCuMgj2FpW95Is_IYT4l4XwnzHAoAsNvBqrFOMH6TSBH-_E1XOCmQZFvjkA75M8xZOoUW_BBqoajQvKkrnkCTwTlhAAK1x6DjTuAjU_fB8Nb6VevGfKuPM0JBgQYd29j4AOvqqxw Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:08.274925 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbcdf72827044c04842b74194eaf13c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}] Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 5013f4ba5cef44f7bdab6531ec0b0836 Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:08.276371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '3b882983-2a84-4113-be09-1878ffe1b724'} Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:08.277162 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:08.278391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:08.280468 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Returning 404 to user: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:08.281398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-cea86f1a-3c9e-4e7f-8379-23345ca8511f tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 404 len: 111 microversion: 2.1 time: 0.045862 Jul 15 17:54:08.287530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 443/905] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:08 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:08.291122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-66d7af8e-a86d-4c5a-be66-36b684c20db8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '.version_select at 0x7f37d1413b80>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:08.376225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-66d7af8e-a86d-4c5a-be66-36b684c20db8 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736369069" status: 202 len: 0 microversion: 2.1 time: 0.089558 Jul 15 17:54:08.377486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 463/906] 10.222.0.57 () {58 vars in 1217 bytes} [Fri Jul 15 17:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736369069 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:54:08.393340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:08.394346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:08.405561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:08.405991 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:08.406936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:08.407455 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:08.606139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:08.615888 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6b43e2f8-a4a6-406c-ba18-65d9325316b9 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.228228 Jul 15 17:54:08.617305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 444/907] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:08 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:09.635087 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:09.637090 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:09.644529 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:09.645086 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:09.645930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:09.646434 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:09.833657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:09.845970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-491eab13-fc9c-460d-8f21-46b8da90afe5 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.211911 Jul 15 17:54:09.845970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 464/908] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:09 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:10.865430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:10.867800 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:10.879535 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:10.880638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:10.883392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:10.884057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:11.117352 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:11.129949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ff33ecad-f2e9-487f-bca6-6cc3ac430bb4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.272848 Jul 15 17:54:11.149066 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 445/909] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:10 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:12.028319 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:12.029565 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:12.044686 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:12.052358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:12.053433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:12.054598 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:12.088793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] HTTP exception thrown: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Request method failure captured: Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 HTTP/1.1 Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agmijePfpTlSOIO8OUrsQe818659KZ3syw0p0rQCuMgj2FpW95Is_IYT4l4XwnzHAoAsNvBqrFOMH6TSBH-_E1XOCmQZFvjkA75M8xZOoUW_BBqoajQvKkrnkCTwTlhAAK1x6DjTuAjU_fB8Nb6VevGfKuPM0JBgQYd29j4AOvqqxw Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:12.090875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbcdf72827044c04842b74194eaf13c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}] Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 5013f4ba5cef44f7bdab6531ec0b0836 Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.092428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '3b882983-2a84-4113-be09-1878ffe1b724'} Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:12.093478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.095459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.098391 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Returning 404 to user: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:12.099637 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-78c52f08-47f8-4d7f-9ea4-003ba9b32535 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 404 len: 111 microversion: 2.1 time: 0.077449 Jul 15 17:54:12.104980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 465/910] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:12 2022] DELETE /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:12.110364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:12.111706 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3b882983-2a84-4113-be09-1878ffe1b724] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:12.119401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:12.121738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:12.122552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:12.123763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:12.124832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:12.149458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:12.150083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:12.156051 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] HTTP exception thrown: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Request method failure captured: Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 HTTP/1.1 Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agmijePfpTlSOIO8OUrsQe818659KZ3syw0p0rQCuMgj2FpW95Is_IYT4l4XwnzHAoAsNvBqrFOMH6TSBH-_E1XOCmQZFvjkA75M8xZOoUW_BBqoajQvKkrnkCTwTlhAAK1x6DjTuAjU_fB8Nb6VevGfKuPM0JBgQYd29j4AOvqqxw Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:12.157768 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbcdf72827044c04842b74194eaf13c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}] Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 5013f4ba5cef44f7bdab6531ec0b0836 Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.159428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '3b882983-2a84-4113-be09-1878ffe1b724'} Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:12.160478 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. Jul 15 17:54:12.163134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:12.165494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:12.165494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:12.165494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:12.165494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:12.168122 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Returning 404 to user: Instance 3b882983-2a84-4113-be09-1878ffe1b724 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:12.169199 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3da06324-e59d-4b64-bad2-f7fd9dd88e0d tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724" status: 404 len: 111 microversion: 2.1 time: 0.063685 Jul 15 17:54:12.171055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 446/911] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:12 2022] GET /compute/v2.1/servers/3b882983-2a84-4113-be09-1878ffe1b724 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:54:12.450930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:12.463786 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-27ed1378-9611-4f4e-81b6-81e42f1187ff tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.318856 Jul 15 17:54:12.466012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 466/912] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:12 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:13.485244 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:13.485900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:13.498346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:13.498802 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:13.499885 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:13.500318 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:13.575781 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:13.576863 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:13.587254 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:13.589942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:13.589942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:13.589942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:13.605409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] HTTP exception thrown: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Request method failure captured: Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 HTTP/1.1 Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agmijePfpTlSOIO8OUrsQe818659KZ3syw0p0rQCuMgj2FpW95Is_IYT4l4XwnzHAoAsNvBqrFOMH6TSBH-_E1XOCmQZFvjkA75M8xZOoUW_BBqoajQvKkrnkCTwTlhAAK1x6DjTuAjU_fB8Nb6VevGfKuPM0JBgQYd29j4AOvqqxw Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:13.607772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbcdf72827044c04842b74194eaf13c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}] Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 5013f4ba5cef44f7bdab6531ec0b0836 Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.609114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '3134e969-15cb-4cac-a35d-a4543cfa8629'} Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:13.609849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.611011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.612827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Returning 404 to user: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:13.612827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e04a7b3e-c3e8-4a67-8117-fe52d814f5d3 tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 404 len: 111 microversion: 2.1 time: 0.042759 Jul 15 17:54:13.612827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 467/913] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:13 2022] DELETE /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:13.621391 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:13.622046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] [instance: 3134e969-15cb-4cac-a35d-a4543cfa8629] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:13.633295 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:13.634048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:13.635159 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:13.635658 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:13.651079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] HTTP exception thrown: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Request method failure captured: Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 HTTP/1.1 Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agmijePfpTlSOIO8OUrsQe818659KZ3syw0p0rQCuMgj2FpW95Is_IYT4l4XwnzHAoAsNvBqrFOMH6TSBH-_E1XOCmQZFvjkA75M8xZOoUW_BBqoajQvKkrnkCTwTlhAAK1x6DjTuAjU_fB8Nb6VevGfKuPM0JBgQYd29j4AOvqqxw Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:13.653201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbcdf72827044c04842b74194eaf13c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbcdf72827044c04842b74194eaf13c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbcdf72827044c04842b74194eaf13c3"}]}] Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: fbcdf72827044c04842b74194eaf13c3 Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-258746879 Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 5013f4ba5cef44f7bdab6531ec0b0836 Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeTestJSON-258746879-project Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.654617 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '3134e969-15cb-4cac-a35d-a4543cfa8629'} Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:13.655527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. Jul 15 17:54:13.656973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:13.658251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] Returning 404 to user: Instance 3134e969-15cb-4cac-a35d-a4543cfa8629 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:13.658251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-517e44c1-3e90-43de-a638-d9cdb5544f8b tempest-AttachVolumeTestJSON-258746879 tempest-AttachVolumeTestJSON-258746879-project] 10.222.0.57 "GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629" status: 404 len: 111 microversion: 2.1 time: 0.041799 Jul 15 17:54:13.659133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 468/914] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:13 2022] GET /compute/v2.1/servers/3134e969-15cb-4cac-a35d-a4543cfa8629 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:54:13.686947 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:13.696876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-497d7fe2-447a-43bf-aa84-002b07200401 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.215674 Jul 15 17:54:13.707225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 447/915] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:13 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:14.581090 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:14.582237 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:14.595885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:14.598543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:14.599376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:14.599905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:14.698561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:14.704707 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lazy-loading 'services' on Instance uuid e9f864a1-cda0-4758-9498-465e0c4a5d83 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:54:14.715422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:14.716635 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:14.732900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:14.733798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:14.741971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:14.741971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:14.903661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:14.915007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-dcbf90a5-21ae-4097-90bf-4343bb45bbbb tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.203751 Jul 15 17:54:14.925475 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 448/916] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:14 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:15.005078 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-77a342aa-3ce9-4b88-bc3f-988ec661d630 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments/d61a1bb2-7584-4e8f-94a4-c31d2a11c66f" status: 202 len: 0 microversion: 2.1 time: 0.427573 Jul 15 17:54:15.018563 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 469/917] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:54:14 2022] DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments/d61a1bb2-7584-4e8f-94a4-c31d2a11c66f => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:54:15.019263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:15.019263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:15.023921 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:15.024682 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:15.026003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:15.026806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:15.064395 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5c606c17-047b-4cb6-9440-3da7de2e0149 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052822 Jul 15 17:54:15.066479 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 449/918] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:54:15 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:15.934450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:15.935169 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:15.946518 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:15.947253 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:15.948385 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:15.949142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:16.083678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:16.084531 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:16.094913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:16.095672 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:16.096843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:16.097507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:16.137044 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c789040c-97d4-4687-96c5-be4681ec9c3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057413 Jul 15 17:54:16.137996 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 450/919] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:54:16 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:54:16.249437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:16.259265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2047b29b-4f6e-40da-bd74-a228eec37fe2 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.330745 Jul 15 17:54:16.269405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 470/920] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:15 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:17.152708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:17.155136 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:17.170705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.171779 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.172848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.173529 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.261280 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-31e2f77f-0595-48c2-8a49-e8079f51e81a tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115791 Jul 15 17:54:17.262603 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 451/921] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:54:17 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:54:17.277241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:17.283799 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:17.287798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.289568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.290550 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.291127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.377183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:17.378941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:17.395007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.396758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.396758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.397407 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.430228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:54:17.476053 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:17.561467 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:17.572626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-20296a75-fe05-43e6-8ec8-9ac374a430cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.299847 Jul 15 17:54:17.573865 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 471/922] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:17 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:17.841716 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2356b9a3-e239-48fc-a33f-c6157534d02c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 204 len: 0 microversion: 2.1 time: 0.468538 Jul 15 17:54:17.843972 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 452/923] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:17 2022] DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:54:17.851783 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:17.852389 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:17.863886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.864337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:17.865258 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:17.865718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:18.057153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:18.069331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7ec8897d-a27b-4706-8d9c-cfca2640ba66 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1682 microversion: 2.1 time: 0.221304 Jul 15 17:54:18.077646 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 472/924] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:17 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:18.590784 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:18.591493 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:18.598308 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:18.598763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:18.599574 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:18.600015 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:18.864619 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:18.873148 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0ef7b1dd-64f2-4d5e-80f5-0398007218da tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.287148 Jul 15 17:54:18.879700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 453/925] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:18 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:18.988118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-ff5bff5f-c35d-4999-9d39-5a9ab30b3ea3 req-bf9e6cec-572a-472c-b79a-3da82ff752ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "name": "network-vif-plugged", "status": "completed", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:19.016876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-ff5bff5f-c35d-4999-9d39-5a9ab30b3ea3 req-bf9e6cec-572a-472c-b79a-3da82ff752ac service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:19.026906 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-ff5bff5f-c35d-4999-9d39-5a9ab30b3ea3 req-bf9e6cec-572a-472c-b79a-3da82ff752ac service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:19.083650 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-ff5bff5f-c35d-4999-9d39-5a9ab30b3ea3 req-bf9e6cec-572a-472c-b79a-3da82ff752ac service nova] Creating event network-vif-plugged:0dad5793-1312-4eb3-912c-d33ba3dd6b43 for instance 2e8e11f1-2777-4750-9a76-49660282b01d on hv-cinder-83697 Jul 15 17:54:19.093884 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:19.094526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:19.100832 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:19.101450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:19.121501 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:19.121501 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:19.129015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-ff5bff5f-c35d-4999-9d39-5a9ab30b3ea3 req-bf9e6cec-572a-472c-b79a-3da82ff752ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143190 Jul 15 17:54:19.132284 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 473/926] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:19.369813 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:19.389707 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2cb519b0-bf87-4860-8aaf-e94e291fecfb tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1682 microversion: 2.1 time: 0.300426 Jul 15 17:54:19.390320 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 454/927] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:19 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1682 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:19.901684 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:19.902656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:19.917961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:19.918683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:19.919996 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:19.921636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:20.409229 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:20.410539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:20.429866 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:20.430127 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:20.433080 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:20.433566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:20.460552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:20.469173 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-01b4bf37-a7d4-4397-a471-213e80275c8d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.576123 Jul 15 17:54:20.483793 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 474/928] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:19 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:20.702982 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:20.712724 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2f3d5f08-c350-458b-b952-84736a28d09b tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1682 microversion: 2.1 time: 0.308382 Jul 15 17:54:20.714615 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 455/929] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:20 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:21.491686 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:21.496048 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:21.517070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:21.519044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:21.520522 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:21.526841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:21.669150 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-546e79ab-d1a0-4553-9e36-41db8a2416c2 req-c2ec25bc-02ae-474f-857b-c710c9cc8180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f864a1-cda0-4758-9498-465e0c4a5d83", "name": "network-vif-deleted", "tag": "4da679fc-62e7-44fe-9105-d7d314d2c6be"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:21.693953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-546e79ab-d1a0-4553-9e36-41db8a2416c2 req-c2ec25bc-02ae-474f-857b-c710c9cc8180 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:21.695790 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-546e79ab-d1a0-4553-9e36-41db8a2416c2 req-c2ec25bc-02ae-474f-857b-c710c9cc8180 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:21.728558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-546e79ab-d1a0-4553-9e36-41db8a2416c2 req-c2ec25bc-02ae-474f-857b-c710c9cc8180 service nova] Creating event network-vif-deleted:4da679fc-62e7-44fe-9105-d7d314d2c6be for instance e9f864a1-cda0-4758-9498-465e0c4a5d83 on hv-cinder-83697 Jul 15 17:54:21.742695 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-546e79ab-d1a0-4553-9e36-41db8a2416c2 req-c2ec25bc-02ae-474f-857b-c710c9cc8180 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076936 Jul 15 17:54:21.746923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 456/930] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:54:21.757926 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:21.768269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:21.773341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:21.773847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:21.777746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:21.778299 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:21.814819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:21.826524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c2141d23-9ccd-4c8f-99ad-9b123723be07 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1575 microversion: 2.1 time: 0.338647 Jul 15 17:54:21.837821 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 475/931] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:21 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1575 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:21.888279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e7019b46d743a1b6b0d3315e69053f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464e33662344d5a80bdfe413b56b5ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:21.897530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5808e319-db92-42d5-8abc-890120ea4a3c tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 200 len: 1614 microversion: 2.1 time: 0.145727 Jul 15 17:54:21.898258 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 457/932] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:21 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 1614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:22.846272 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:22.846272 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:22.854076 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:22.854530 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:22.855315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:22.855755 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:22.917617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:22.918252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:22.929180 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:22.932532 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:22.939135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:22.939135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:22.960283 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 HTTP/1.1 Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:22.963238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:22.964899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'e9f864a1-cda0-4758-9498-465e0c4a5d83'} Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:22.965689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:22.966987 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:22.968107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:22.968107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c260dc01-35fe-4411-a580-a8732d736086 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 404 len: 111 microversion: 2.1 time: 0.052378 Jul 15 17:54:22.968693 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 458/933] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:22 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:22.974004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-13becfbb-a725-4b85-8fb1-a02d74b3578d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '.version_select at 0x7f37d13c1dc0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:23.031982 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:23.040695 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c580193f-1bc4-454b-976d-970f008a76e3 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1562 microversion: 2.1 time: 0.200017 Jul 15 17:54:23.053197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 476/934] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:22 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1562 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:23.084779 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-13becfbb-a725-4b85-8fb1-a02d74b3578d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738494580" status: 202 len: 0 microversion: 2.1 time: 0.114491 Jul 15 17:54:23.086497 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 459/935] 10.222.0.57 () {58 vars in 1217 bytes} [Fri Jul 15 17:54:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738494580 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:54:25.297444 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:25.297987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:25.304785 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:25.305842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:25.306650 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:25.307091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:25.322035 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 HTTP/1.1 Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:25.323813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.325188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'e9f864a1-cda0-4758-9498-465e0c4a5d83'} Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:25.325911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.327683 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.329264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:25.329264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-06f07f55-4290-4311-af19-5b7b3f37486e tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 404 len: 111 microversion: 2.1 time: 0.031713 Jul 15 17:54:25.329264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 477/936] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:25 2022] DELETE /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:25.334361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:25.335173 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: e9f864a1-cda0-4758-9498-465e0c4a5d83] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:25.346616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:25.347379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:25.348192 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:25.348645 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:25.373537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 HTTP/1.1 Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:25.375472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.376837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'e9f864a1-cda0-4758-9498-465e0c4a5d83'} Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:25.377568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. Jul 15 17:54:25.378848 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:25.379899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance e9f864a1-cda0-4758-9498-465e0c4a5d83 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:25.379899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f9f2d1a0-7cc0-4c16-b192-031e77b4b3a0 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83" status: 404 len: 111 microversion: 2.1 time: 0.047118 Jul 15 17:54:25.379899 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 460/937] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:25 2022] GET /compute/v2.1/servers/e9f864a1-cda0-4758-9498-465e0c4a5d83 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:26.697345 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:26.698011 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:26.708182 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.708720 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.709511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.709979 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.732269 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 HTTP/1.1 Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:26.734430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.736150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '71453995-f196-42f7-beab-0b655b9a9703'} Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:26.737133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.739103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.740435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:26.740435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a6ec5794-e3a0-458f-975e-68e76babf136 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 404 len: 111 microversion: 2.1 time: 0.044127 Jul 15 17:54:26.740435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 478/938] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:26 2022] DELETE /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:26.746726 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:26.747343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 71453995-f196-42f7-beab-0b655b9a9703] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:26.754366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.754820 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.755577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.756011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.770216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 HTTP/1.1 Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:26.771746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.773315 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '71453995-f196-42f7-beab-0b655b9a9703'} Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:26.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. Jul 15 17:54:26.776209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.777594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 71453995-f196-42f7-beab-0b655b9a9703 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:26.777594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-11655fc1-2097-41a7-9b5e-556939f232c8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703" status: 404 len: 111 microversion: 2.1 time: 0.031353 Jul 15 17:54:26.777594 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 461/939] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:26 2022] GET /compute/v2.1/servers/71453995-f196-42f7-beab-0b655b9a9703 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:26.782459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:26.783012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:26.789547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.790021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.790971 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.791476 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.810190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 HTTP/1.1 Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:26.811831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.813659 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '36cd5a6a-1e60-47ed-8ccd-a19e52410f79'} Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:26.814704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.816265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.817875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:26.817875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-81173bc8-052e-4184-844b-a100b29b43b8 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 404 len: 111 microversion: 2.1 time: 0.034958 Jul 15 17:54:26.817875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 479/940] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:26 2022] DELETE /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:26.823401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:26.824047 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 36cd5a6a-1e60-47ed-8ccd-a19e52410f79] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:26.830418 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.830870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.831991 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:26.832113 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:26.846678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 HTTP/1.1 Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:26.848422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.861441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '36cd5a6a-1e60-47ed-8ccd-a19e52410f79'} Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:26.862399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. Jul 15 17:54:26.863962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:26.865566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 36cd5a6a-1e60-47ed-8ccd-a19e52410f79 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:26.865566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0bcbaeed-2670-4b0e-b67c-34085e09686d tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79" status: 404 len: 111 microversion: 2.1 time: 0.030882 Jul 15 17:54:26.865566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 462/941] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:26 2022] GET /compute/v2.1/servers/36cd5a6a-1e60-47ed-8ccd-a19e52410f79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 15 17:54:28.217292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ea858ee0-fe57-417e-8a67-ec50df73d2fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Action: 'create', calling method: .version_select at 0x7f37d14580d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-399712967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGugZA9AXi1BrCaGRxfHc65H9PD2NXyhgFpndQUY3ZarXTM23j7BfRDJJ41uOVrde7+TQgfhO3S6V8sno8ipwmUZcM9f8CFyAYuejHRyDbXyUhVQOAYLSsPNb9E8PNvf9w=="}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:28.231999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-ea858ee0-fe57-417e-8a67-ec50df73d2fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Getting quotas for project 08c91c6b348e4840939870bf231d5a91. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:54:28.235887 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-ea858ee0-fe57-417e-8a67-ec50df73d2fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Getting quotas for user 98b93d5a1e5b4c46b505cdacf707ee1a and project 08c91c6b348e4840939870bf231d5a91. Resources: {'key_pairs'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:54:28.330054 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ea858ee0-fe57-417e-8a67-ec50df73d2fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.116555 Jul 15 17:54:28.330651 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 480/942] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:54:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:54:28.427285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1184910684", "imageRef": "1dc760b0-bdb8-47de-b8ca-25f61b95cb35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-399712967", "networks": [{"uuid": "873bdf8c-8345-4d5a-94fe-9d9b844130d3"}]}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:28.454531 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:28.455101 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:28.462682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:28.463133 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:28.463899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:28.464337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:28.478057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 HTTP/1.1 Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:28.479635 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.481430 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '66074efc-9ad1-4fff-89f6-b16920004511'} Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:28.482490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.483697 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.485162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:28.485162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-377bd7bc-fc2a-4e10-a9b3-c2448e3d5409 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 404 len: 111 microversion: 2.1 time: 0.030461 Jul 15 17:54:28.485162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 481/943] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:54:28 2022] DELETE /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:28.486564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.network.neutron [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] validate_networks() for [('873bdf8c-8345-4d5a-94fe-9d9b844130d3', None, None, None, None, None)] {{(pid=124745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:54:28.489107 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:28.489710 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] [instance: 66074efc-9ad1-4fff-89f6-b16920004511] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:28.495694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:28.496142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:28.497002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:28.497439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:28.511130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] HTTP exception thrown: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Request method failure captured: Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 HTTP/1.1 Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0aglpK6JP1cVcbf8yCs0JPKCYQ64wKuGO91d7op4zIrS3pNPvxtz_XQDy0vpIFqn7kn1klrsBmIDlIaOywrYUmzrNIioV4r1dOs2Q7CFBVqWNQLhhghdEPo9mHfBQmrccFKkkOAbSjiCt5DMfvjKypAC4rjGAE7rz18-AdjenYqQ9C8 Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:28.512854 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b464e33662344d5a80bdfe413b56b5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b464e33662344d5a80bdfe413b56b5ec", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b464e33662344d5a80bdfe413b56b5ec"}]}] Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: b464e33662344d5a80bdfe413b56b5ec Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-611156592 Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 34e7019b46d743a1b6b0d3315e69053f Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeNegativeTest-611156592-project Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.514422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '66074efc-9ad1-4fff-89f6-b16920004511'} Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:28.515177 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. Jul 15 17:54:28.516435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:28.522689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] Returning 404 to user: Instance 66074efc-9ad1-4fff-89f6-b16920004511 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:28.522689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-bd1aa374-b93e-45ec-b4d8-cd3d4e187285 tempest-AttachVolumeNegativeTest-611156592 tempest-AttachVolumeNegativeTest-611156592-project] 10.222.0.57 "GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511" status: 404 len: 111 microversion: 2.1 time: 0.028749 Jul 15 17:54:28.522689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 482/944] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:28 2022] GET /compute/v2.1/servers/66074efc-9ad1-4fff-89f6-b16920004511 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:54:28.935027 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Flavor limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:54:28.935452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Image limits 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:54:28.935920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Flavor pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:54:28.936328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Image pref 0:0:0 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:54:28.936763 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.virt.hardware [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:54:28.947584 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:28.948034 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:28.948870 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:28.949308 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:28.968021 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Getting quotas for project 08c91c6b348e4840939870bf231d5a91. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:54:28.972526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Getting quotas for user 98b93d5a1e5b4c46b505cdacf707ee1a and project 08c91c6b348e4840939870bf231d5a91. Resources: {'ram', 'instances', 'cores'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:54:28.983988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Going to run 1 instances... {{(pid=124745) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:54:28.986517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1dc760b0-bdb8-47de-b8ca-25f61b95cb35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:54:29.107844 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8c692fb1-d5d3-4d9c-90af-94ff34f1a5fd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684456 Jul 15 17:54:29.108891 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 463/945] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:54:29.122423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2e187527-fa73-4b0d-8b87-c0bbd1cbcadc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:29.123338 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2e187527-fa73-4b0d-8b87-c0bbd1cbcadc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:29.209184 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2e187527-fa73-4b0d-8b87-c0bbd1cbcadc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:29.217047 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2e187527-fa73-4b0d-8b87-c0bbd1cbcadc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1258 microversion: 2.1 time: 0.101187 Jul 15 17:54:29.217888 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 483/946] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:29 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:29.417623 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:29.418620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:29.425876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:29.426334 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:29.427199 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:29.427558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:29.461542 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8b9582b6-8875-42b1-9f96-1b1f6af76f5a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048608 Jul 15 17:54:29.467124 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 464/947] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 15 17:54:29 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:29.534661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:29.535154 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:29.546472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:29.546472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:29.546472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:29.546965 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:29.580237 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:54:29.969402 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6dd62d5e-e6a7-45b6-883d-e996ed19c956 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 204 len: 0 microversion: 2.20 time: 0.438882 Jul 15 17:54:29.969939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 484/948] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 15 17:54:29 2022] DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 17:54:29.978867 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:29.979853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:29.985578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:29.986004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:29.986764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:29.987201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:30.128565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:30.136941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:30.138522 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:30.139689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3643af2d-21f2-45cb-85fa-3c1be3c38dbf tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.165437 Jul 15 17:54:30.140238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 465/949] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:29 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:54:30.238299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-37fb1e0f-33b2-440c-ab0b-37c5df097f1b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:30.239191 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-37fb1e0f-33b2-440c-ab0b-37c5df097f1b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:30.309578 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-37fb1e0f-33b2-440c-ab0b-37c5df097f1b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:30.316766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-37fb1e0f-33b2-440c-ab0b-37c5df097f1b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1258 microversion: 2.1 time: 0.084156 Jul 15 17:54:30.317334 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 485/950] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:30 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:31.159976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:31.161345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:31.169398 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:31.170156 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:31.171129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:31.171813 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:31.327565 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:31.336288 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:31.337853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:31.339219 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-32840b6a-d349-491a-89cc-f2d8fdcbdc48 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.183589 Jul 15 17:54:31.339778 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 466/951] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:31 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:54:31.340621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:31.340621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:31.347588 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:31.348051 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:31.349072 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:31.349570 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:31.445228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:31.452744 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-285f62d2-4f57-4b72-84dd-58a556f44ccc tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1262 microversion: 2.1 time: 0.117355 Jul 15 17:54:31.453305 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 486/952] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:31 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:32.357964 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:32.358573 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:32.365101 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:32.365544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:32.366343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:32.366721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:32.475632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:32.475632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:32.475632 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:32.479378 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:32.479805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:32.480572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:32.481049 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:32.502904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:32.509588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:32.511049 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:32.512215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ce7abab9-193f-449a-b8ec-f0f18bc51cb6 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.158126 Jul 15 17:54:32.512995 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 467/953] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:32 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:54:32.563725 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:32.572768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-160b7066-8cc4-4c5f-afe7-0d5229c639a2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1262 microversion: 2.1 time: 0.106309 Jul 15 17:54:32.573487 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 487/954] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:32 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:33.530605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:33.531228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:33.537811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:33.538359 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:33.539102 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:33.539537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:33.592428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:33.593800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:33.605501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:33.605501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:33.605501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:33.605501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:33.675287 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:33.685097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1a2287c8-4dfa-4940-b683-8c1b8bfc9493 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1262 microversion: 2.1 time: 0.098862 Jul 15 17:54:33.686153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 488/955] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:33 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:33.688971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:33.697267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:33.699487 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:33.701381 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d317f6aa-b176-4786-847d-7010006d439a tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1724 microversion: 2.20 time: 0.174681 Jul 15 17:54:33.703112 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 468/956] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:33 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:54:34.703330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:34.703987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:34.712047 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:34.712541 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:34.713552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:34.713989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:34.719761 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:34.721842 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:34.730726 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:34.732109 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:34.733347 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:34.734014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:34.805388 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:34.823280 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8091e48c-4d01-46a9-b6ae-f0edba75e73a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1318 microversion: 2.1 time: 0.123755 Jul 15 17:54:34.825694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 489/957] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:34 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1318 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:34.907952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:34.914225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-f8498421-bed8-48d3-a74e-e54a0616954e req-21c4f096-af3a-4d0b-abcf-164122cf6f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07858177-9488-4d02-8097-a843a7d7ee0a", "name": "network-vif-deleted", "tag": "afcc3cea-0035-4c0b-8b49-8a6746f1c6da"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:34.927782 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:34.942646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:34.942646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-36851061-4ddb-4611-a35c-de10336d7b4c tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1656 microversion: 2.20 time: 0.216630 Jul 15 17:54:34.942646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 469/958] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:34 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1656 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 15 17:54:34.948563 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-f8498421-bed8-48d3-a74e-e54a0616954e req-21c4f096-af3a-4d0b-abcf-164122cf6f8d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:34.949436 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-f8498421-bed8-48d3-a74e-e54a0616954e req-21c4f096-af3a-4d0b-abcf-164122cf6f8d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:34.963453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-f8498421-bed8-48d3-a74e-e54a0616954e req-21c4f096-af3a-4d0b-abcf-164122cf6f8d service nova] Creating event network-vif-deleted:afcc3cea-0035-4c0b-8b49-8a6746f1c6da for instance 07858177-9488-4d02-8097-a843a7d7ee0a on hv-cinder-83697 Jul 15 17:54:34.969243 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-f8498421-bed8-48d3-a74e-e54a0616954e req-21c4f096-af3a-4d0b-abcf-164122cf6f8d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058769 Jul 15 17:54:34.970422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 490/959] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:54:35.843260 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:35.844494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:35.851812 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:35.853327 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:35.853327 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:35.853504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:35.951820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:35.952642 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:35.976140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:35.976140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:35.996413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:35.996937 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:36.058931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:36.059411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:36.060066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lazy-loading 'fault' on Instance uuid 07858177-9488-4d02-8097-a843a7d7ee0a {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:54:36.062244 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:36.134643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:36.146966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:36.149845 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'caab1412244c43adac226cb253a10880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a00a57ce8e46f0b0936cbe9c6ae9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:36.151261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a6b7e101-adbe-4749-ab46-4ce355d23e2d tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 200 len: 1372 microversion: 2.20 time: 0.204708 Jul 15 17:54:36.152479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 491/960] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:35 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 15 17:54:36.233887 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:36.246179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-98e89502-6717-43b0-8f7a-9dfcd7f88047 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.405517 Jul 15 17:54:36.258059 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 470/961] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:35 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:36.555993 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-88aebd44-5165-4742-9539-25035a319418 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d151f790>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:36.639161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-88aebd44-5165-4742-9539-25035a319418 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84efc199-68ea-407c-9a82-5a796e4271e4" status: 200 len: 350 microversion: 2.1 time: 0.087814 Jul 15 17:54:36.647428 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 492/962] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:54:36 2022] GET /compute/v2.1/os-volumes/84efc199-68ea-407c-9a82-5a796e4271e4 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:37.179305 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:37.181226 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:37.217061 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:37.223313 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:37.223313 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:37.247030 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:37.268012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:37.268913 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:37.304127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:37.304782 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:37.305852 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:37.308164 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:37.650072 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:37.686999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-38da2d61-1bfd-493d-8831-77e5beb254e1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.423436 Jul 15 17:54:37.688229 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 493/963] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:37 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:37.693283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-d0e9b5f4-1e89-4c42-a42b-2d2754717763 req-ed29e6c6-3792-4dd8-80e5-bdc9d359a2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:37.712903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d0e9b5f4-1e89-4c42-a42b-2d2754717763 req-ed29e6c6-3792-4dd8-80e5-bdc9d359a2de service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:37.713606 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d0e9b5f4-1e89-4c42-a42b-2d2754717763 req-ed29e6c6-3792-4dd8-80e5-bdc9d359a2de service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:37.740127 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] HTTP exception thrown: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Request method failure captured: Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a HTTP/1.1 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agvNcFUBbRXp3k5469Dtd39LqsQ5KrO4OwMfkbYzSRZ8FJhsUk1wgHBuQmywlLBZy-sDiYwU9WILdMxPav9Kaezrn7YYm_HIkAs8cLKdbI5FqjDJ3R5pjbRLNwAvum-qHPKqzbPzzcAHV8GA_vSUN_aKnzuUAq5HqAIDHgyLL5jAi8 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:37.743324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14a00a57ce8e46f0b0936cbe9c6ae9d8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}] Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: caab1412244c43adac226cb253a10880 Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:37.744847 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '07858177-9488-4d02-8097-a843a7d7ee0a'} Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:37.745625 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:37.747648 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:37.749483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Returning 404 to user: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:37.749483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-82d298cb-e468-490a-920a-d0bbedc27a69 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 404 len: 111 microversion: 2.20 time: 0.577585 Jul 15 17:54:37.749483 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 471/964] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:37 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 111 bytes in 580 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:54:37.757147 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-42a6b2ad-caf1-4bfa-84c1-3f47d8c209c9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '.version_select at 0x7f37d13515e0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:37.765131 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-d0e9b5f4-1e89-4c42-a42b-2d2754717763 req-ed29e6c6-3792-4dd8-80e5-bdc9d359a2de service nova] Creating event network-changed:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:54:37.770461 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-d0e9b5f4-1e89-4c42-a42b-2d2754717763 req-ed29e6c6-3792-4dd8-80e5-bdc9d359a2de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080824 Jul 15 17:54:37.771729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 494/965] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:37.852961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-42a6b2ad-caf1-4bfa-84c1-3f47d8c209c9 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832225276" status: 204 len: 0 microversion: 2.20 time: 0.099574 Jul 15 17:54:37.853643 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 472/966] 10.222.0.57 () {60 vars in 1261 bytes} [Fri Jul 15 17:54:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832225276 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 15 17:54:38.399433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fc1e8237-fe72-4c3a-b56c-5809e5a6e99d tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d14dcee0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:38.521576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fc1e8237-fe72-4c3a-b56c-5809e5a6e99d tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9b669571-ba93-4f8d-96f6-dbfb46d23980" status: 200 len: 350 microversion: 2.1 time: 0.130250 Jul 15 17:54:38.522148 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 495/967] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:54:38 2022] GET /compute/v2.1/os-volumes/9b669571-ba93-4f8d-96f6-dbfb46d23980 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:38.704099 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:38.705036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:38.712514 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:38.713001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:38.713785 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:38.714229 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:38.943204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:38.959247 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1a4fbac5-8a09-45c6-b14a-69dc7ddd9f97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.258203 Jul 15 17:54:38.961600 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 473/968] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:38 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:39.976023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:39.978052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:39.985347 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:39.986076 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:39.987385 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:39.988049 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:40.152866 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:40.161630 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0846e03f-0939-4697-9a81-ef4bb66d16a9 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.189885 Jul 15 17:54:40.162211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 496/969] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:39 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:40.353057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9507ee8b-f97c-4348-9448-fbec1ae47706 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d1361ee0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.366461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:40.368002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=6 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:40.368586 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.369458 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:40.373398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=8 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:40.379689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:40.380569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:40.382437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:40.384325 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:40.404166 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] HTTP exception thrown: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Request method failure captured: Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a HTTP/1.1 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agvNcFUBbRXp3k5469Dtd39LqsQ5KrO4OwMfkbYzSRZ8FJhsUk1wgHBuQmywlLBZy-sDiYwU9WILdMxPav9Kaezrn7YYm_HIkAs8cLKdbI5FqjDJ3R5pjbRLNwAvum-qHPKqzbPzzcAHV8GA_vSUN_aKnzuUAq5HqAIDHgyLL5jAi8 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:40.406162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14a00a57ce8e46f0b0936cbe9c6ae9d8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}] Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: caab1412244c43adac226cb253a10880 Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.410797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '07858177-9488-4d02-8097-a843a7d7ee0a'} Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:40.412046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.413472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.416030 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Returning 404 to user: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:40.416030 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-01ad649a-19ad-4424-8b5d-b1a72d283885 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 404 len: 111 microversion: 2.20 time: 0.047048 Jul 15 17:54:40.416030 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 497/970] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 15 17:54:40 2022] DELETE /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 15 17:54:40.418537 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.419363 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: 07858177-9488-4d02-8097-a843a7d7ee0a] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:40.426684 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:40.427132 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:40.427909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:40.428372 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:40.438025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9507ee8b-f97c-4348-9448-fbec1ae47706 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/10e0bf40-23b4-4c2a-83f9-c119b05c0eb9" status: 200 len: 351 microversion: 2.1 time: 0.089699 Jul 15 17:54:40.438622 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 474/971] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/os-volumes/10e0bf40-23b4-4c2a-83f9-c119b05c0eb9 => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:40.450902 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-53b1df06-348f-49ca-9f5b-c7b609d2fb1e tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d1351310>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.456412 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] HTTP exception thrown: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Request method failure captured: Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a HTTP/1.1 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agvNcFUBbRXp3k5469Dtd39LqsQ5KrO4OwMfkbYzSRZ8FJhsUk1wgHBuQmywlLBZy-sDiYwU9WILdMxPav9Kaezrn7YYm_HIkAs8cLKdbI5FqjDJ3R5pjbRLNwAvum-qHPKqzbPzzcAHV8GA_vSUN_aKnzuUAq5HqAIDHgyLL5jAi8 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:40.458729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14a00a57ce8e46f0b0936cbe9c6ae9d8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}] Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: caab1412244c43adac226cb253a10880 Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.468126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '07858177-9488-4d02-8097-a843a7d7ee0a'} Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:40.469548 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. Jul 15 17:54:40.470987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:40.472053 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Returning 404 to user: Instance 07858177-9488-4d02-8097-a843a7d7ee0a could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:40.472053 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9dd02975-b98e-458c-b328-2121c67ad112 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a" status: 404 len: 111 microversion: 2.20 time: 0.047390 Jul 15 17:54:40.472053 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 498/972] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/servers/07858177-9488-4d02-8097-a843a7d7ee0a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:54:40.543605 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-53b1df06-348f-49ca-9f5b-c7b609d2fb1e tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096917 Jul 15 17:54:40.544341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 475/973] 10.222.0.57 () {58 vars in 1133 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:40.556460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-df8347a3-f535-4328-8c1b-9f07323a1785 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d13cc5e0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.673904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-df8347a3-f535-4328-8c1b-9f07323a1785 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.121142 Jul 15 17:54:40.682005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 499/974] 10.222.0.57 () {58 vars in 1148 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:40.688588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-99b21d76-1c30-448d-be06-99690c536b4b tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d13c14c0>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.784977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-99b21d76-1c30-448d-be06-99690c536b4b tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101363 Jul 15 17:54:40.785858 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 476/975] 10.222.0.57 () {58 vars in 1133 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:40.799008 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6751ac5f-f804-4307-af12-5a3aa3d3d35f tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d14dcc10>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:40.965729 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6751ac5f-f804-4307-af12-5a3aa3d3d35f tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.170670 Jul 15 17:54:40.966471 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 500/976] 10.222.0.57 () {58 vars in 1166 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:40.982067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-29d669b8-6220-45a0-af6a-9b3ecf36971a tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d13c1310>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.101878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-29d669b8-6220-45a0-af6a-9b3ecf36971a tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.123033 Jul 15 17:54:41.103752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 477/977] 10.222.0.57 () {58 vars in 1169 bytes} [Fri Jul 15 17:54:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:41.116516 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a04c3b37-5398-4375-afe8-1ad5ef3d60d4 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d1413940>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.180585 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.181387 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:41.198091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:41.198091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:41.198091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:41.198091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:41.213511 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a04c3b37-5398-4375-afe8-1ad5ef3d60d4 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101943 Jul 15 17:54:41.214123 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 501/978] 10.222.0.57 () {58 vars in 1154 bytes} [Fri Jul 15 17:54:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:41.231872 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-32111b00-683c-4b46-8fac-0121c65482bb tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d14473a0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.357472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-32111b00-683c-4b46-8fac-0121c65482bb tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135887 Jul 15 17:54:41.358339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 502/979] 10.222.0.57 () {58 vars in 1187 bytes} [Fri Jul 15 17:54:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:41.371451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c382c853-b809-4802-b5b3-c96cba1aa840 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] Calling method '.version_select at 0x7f37d14580d0>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.426727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:41.440976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-754ba3b0-7722-4a69-b493-1f67fb63a753 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.262544 Jul 15 17:54:41.442440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 478/980] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:41 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:41.487962 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c382c853-b809-4802-b5b3-c96cba1aa840 tempest-VolumesTestJSON-415475201 tempest-VolumesTestJSON-415475201-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.121681 Jul 15 17:54:41.488653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 503/981] 10.222.0.57 () {58 vars in 1154 bytes} [Fri Jul 15 17:54:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:41.791770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.792202 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:41.807453 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:41.807914 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:41.808766 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:41.809216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:41.816070 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:41.828078 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] HTTP exception thrown: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Request method failure captured: Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 HTTP/1.1 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0agvNcFUBbRXp3k5469Dtd39LqsQ5KrO4OwMfkbYzSRZ8FJhsUk1wgHBuQmywlLBZy-sDiYwU9WILdMxPav9Kaezrn7YYm_HIkAs8cLKdbI5FqjDJ3R5pjbRLNwAvum-qHPKqzbPzzcAHV8GA_vSUN_aKnzuUAq5HqAIDHgyLL5jAi8 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:54:41.829900 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14a00a57ce8e46f0b0936cbe9c6ae9d8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}] Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: caab1412244c43adac226cb253a10880 Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.831495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'a1eee81c-2157-4056-bb4c-8e7a628d96b9'} Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:41.832337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.833791 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.836137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Returning 404 to user: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:41.836137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-035bd5be-44c1-4367-b0d1-fe1b0f23cf49 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 404 len: 111 microversion: 2.20 time: 0.043522 Jul 15 17:54:41.836137 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 479/982] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 15 17:54:41 2022] DELETE /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:54:41.841290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:41.845407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] [instance: a1eee81c-2157-4056-bb4c-8e7a628d96b9] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:41.850900 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:41.851413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:41.852257 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:41.852722 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:41.869616 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] HTTP exception thrown: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Request method failure captured: Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 HTTP/1.1 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0agvNcFUBbRXp3k5469Dtd39LqsQ5KrO4OwMfkbYzSRZ8FJhsUk1wgHBuQmywlLBZy-sDiYwU9WILdMxPav9Kaezrn7YYm_HIkAs8cLKdbI5FqjDJ3R5pjbRLNwAvum-qHPKqzbPzzcAHV8GA_vSUN_aKnzuUAq5HqAIDHgyLL5jAi8 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Openstack-Nova-Api-Version: 2.20 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:54:41.872118 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14a00a57ce8e46f0b0936cbe9c6ae9d8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14a00a57ce8e46f0b0936cbe9c6ae9d8"}]}] Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 14a00a57ce8e46f0b0936cbe9c6ae9d8 Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-245773855 Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: caab1412244c43adac226cb253a10880 Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-245773855-project Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.874130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'a1eee81c-2157-4056-bb4c-8e7a628d96b9'} Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:54:41.875083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. Jul 15 17:54:41.876674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:54:41.881942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] Returning 404 to user: Instance a1eee81c-2157-4056-bb4c-8e7a628d96b9 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:54:41.881942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9768eb38-d1f0-482e-9878-a281f5156664 tempest-AttachVolumeShelveTestJSON-245773855 tempest-AttachVolumeShelveTestJSON-245773855-project] 10.222.0.57 "GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9" status: 404 len: 111 microversion: 2.20 time: 0.042361 Jul 15 17:54:41.885413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 504/983] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 15 17:54:41 2022] GET /compute/v2.1/servers/a1eee81c-2157-4056-bb4c-8e7a628d96b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 15 17:54:42.459184 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:42.459992 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:42.468175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:42.469191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:42.470237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:42.470814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:42.661760 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:42.670691 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-73ba7d76-37fc-493c-a671-c93c58afd88e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.215716 Jul 15 17:54:42.671254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 480/984] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:42 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:43.689519 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:43.690142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:43.701193 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:43.702285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:43.702437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:43.706001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:44.081992 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:44.096579 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dd6d001f-7c04-43d6-a495-770ce77bd870 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.410779 Jul 15 17:54:44.109328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 505/985] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:43 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:45.113797 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:45.114416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:45.116846 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:54:45.121976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:45.122432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:45.123787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:45.124248 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:45.441059 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:45.448349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fe6ac7d8-ecb9-4ea1-8b87-479d45080792 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.338794 Jul 15 17:54:45.457812 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 481/986] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:45 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:46.464708 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:46.465365 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:46.473271 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:46.473938 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:46.474750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:46.475188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:46.740433 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:46.753904 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-ad2ffd2a-943c-43dc-b429-03cb29150f54 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.292751 Jul 15 17:54:46.755651 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 506/987] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:46 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:47.774401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:47.776408 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:47.791929 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:47.792346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:47.793553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:47.794220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:48.007762 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:48.015511 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-29d82851-3111-41e0-89c4-8ef07e63310b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.247735 Jul 15 17:54:48.016070 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 482/988] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:47 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:49.032212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:49.032846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:49.039953 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:49.040394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:49.041238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:49.041672 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:49.178891 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:49.187813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-298c2eca-e208-4747-89be-63c774e39d97 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.159490 Jul 15 17:54:49.188371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 507/989] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:49 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:50.204425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:50.205006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:50.211525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:50.212186 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:50.213171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:50.213606 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:50.345466 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:50.352809 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8d1f3d91-9a7b-4cf5-b0f5-d820020e8084 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.152428 Jul 15 17:54:50.353362 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 483/990] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:50 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:50.919927 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-c8ca5148-1bae-4e7f-b6cd-27a92c97b304 req-b4dda4dd-586c-45d6-8dd8-027b97ded40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "name": "network-vif-plugged", "status": "completed", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:50.928826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-c8ca5148-1bae-4e7f-b6cd-27a92c97b304 req-b4dda4dd-586c-45d6-8dd8-027b97ded40a service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:50.929830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-c8ca5148-1bae-4e7f-b6cd-27a92c97b304 req-b4dda4dd-586c-45d6-8dd8-027b97ded40a service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:50.941306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-c8ca5148-1bae-4e7f-b6cd-27a92c97b304 req-b4dda4dd-586c-45d6-8dd8-027b97ded40a service nova] Creating event network-vif-plugged:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:54:50.946689 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-c8ca5148-1bae-4e7f-b6cd-27a92c97b304 req-b4dda4dd-586c-45d6-8dd8-027b97ded40a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 Jul 15 17:54:50.947358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 508/991] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:54:51.370157 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:51.370771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:51.377573 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:51.378028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:51.379110 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:51.379219 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:51.513718 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:51.521097 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7806058a-f577-426a-837b-c6b30fb45474 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.155512 Jul 15 17:54:51.521652 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 484/992] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:51 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:52.537977 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:52.538602 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:52.545410 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:52.549651 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:52.549651 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:52.549651 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:52.728449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:52.735868 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-840029b5-879d-47c1-a424-452fec9bca12 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1358 microversion: 2.1 time: 0.202275 Jul 15 17:54:52.736426 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 509/993] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:52 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:53.753643 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:53.754262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:53.761672 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:53.762127 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:53.762906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:53.763336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:53.964306 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:53.978209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a2d4b802-e69c-4f69-8ca9-cffee8ebcca6 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1549 microversion: 2.1 time: 0.228358 Jul 15 17:54:53.978966 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 485/994] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:53 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:53.998842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:53.999517 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:54.006926 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:54.008001 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:54.008903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:54.009344 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:54.417740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:54.425380 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-724fa227-16cb-4a2e-9900-16ccdde08331 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1549 microversion: 2.1 time: 0.434323 Jul 15 17:54:54.426264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 510/995] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:53 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1549 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:54:54.441402 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:54.445458 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:54.446217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Searching by: {'deleted': False, 'project_id': '08c91c6b348e4840939870bf231d5a91'} {{(pid=124745) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 15 17:54:54.454506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:54.457201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:54.457201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:54.457201 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:54.551237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.multi_cell_list [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 15 17:54:54.647338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c5ce09ba-3c56-44df-b8d1-954d285ad065 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209906 Jul 15 17:54:54.650985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 486/996] 10.222.0.57 () {58 vars in 1124 bytes} [Fri Jul 15 17:54:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:54:54.659930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:54:54.660549 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:54.666616 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:54.667067 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:54.667869 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:54.668308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:54.801290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:54:54.809504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0d009f7f-f14d-4362-89f8-99448373ed10 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1549 microversion: 2.1 time: 0.153444 Jul 15 17:54:54.810081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 511/997] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:54:54 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:54:57.944528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5250d57f-4738-43dc-b1d2-73813fda02d4"}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:54:57.945677 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:54:57.952263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:57.957753 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:57.957753 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:54:57.957753 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:54:58.876446 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-1b15a1ed-0231-436f-adef-666b92d761e8 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935666 Jul 15 17:54:58.879500 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 487/998] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 15 17:54:57 2022] POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:55:06.578553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:06.579168 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:06.581993 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=37 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:06.582653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=61 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:06.588457 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:06.588961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:06.594833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:06.594833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:06.744623 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:06.754765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-010f8817-3e99-493d-acf9-597d17a17c49 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1595 microversion: 2.1 time: 0.179989 Jul 15 17:55:06.755594 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 512/999] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:06 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1595 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:09.271980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:09.273331 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=13 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:09.274002 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:09.278279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-0aad2a33-2c25-473c-96b4-5729478420b8 req-0bebdcc1-16d8-4056-b747-02c3a705255f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:09.287020 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-0aad2a33-2c25-473c-96b4-5729478420b8 req-0bebdcc1-16d8-4056-b747-02c3a705255f service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:09.287506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-0aad2a33-2c25-473c-96b4-5729478420b8 req-0bebdcc1-16d8-4056-b747-02c3a705255f service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:09.299908 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-0aad2a33-2c25-473c-96b4-5729478420b8 req-0bebdcc1-16d8-4056-b747-02c3a705255f service nova] Creating event network-changed:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:55:09.304938 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-0aad2a33-2c25-473c-96b4-5729478420b8 req-0bebdcc1-16d8-4056-b747-02c3a705255f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Jul 15 17:55:09.305609 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 488/1000] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:55:12.257481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1486056178"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:12.258171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:12.266643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:12.267101 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:12.267927 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:12.268357 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:12.404499 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.network.security_group_api [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Adding security group fd1c1811-0995-465d-a362-eea490547a9e to port 9fc7d179-ebd6-4dcb-bbff-283282b30071 Jul 15 17:55:12.927466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-82666105-2a51-45ad-a178-c1dc7af8c102 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/action" status: 202 len: 0 microversion: 2.1 time: 0.682284 Jul 15 17:55:12.927687 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 513/1001] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:55:12 2022] POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:55:12.939460 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:12.940756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:12.951973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-6b4f9ba1-2c9c-4627-9a69-39c8cd334848 req-a403066d-2854-4c6a-a284-03f31d6ba43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:12.970058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:12.970899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6b4f9ba1-2c9c-4627-9a69-39c8cd334848 req-a403066d-2854-4c6a-a284-03f31d6ba43e service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:12.971482 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:12.972284 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:12.983598 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6b4f9ba1-2c9c-4627-9a69-39c8cd334848 req-a403066d-2854-4c6a-a284-03f31d6ba43e service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:12.988110 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:13.027075 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-6b4f9ba1-2c9c-4627-9a69-39c8cd334848 req-a403066d-2854-4c6a-a284-03f31d6ba43e service nova] Creating event network-changed:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:55:13.037493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-6b4f9ba1-2c9c-4627-9a69-39c8cd334848 req-a403066d-2854-4c6a-a284-03f31d6ba43e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090311 Jul 15 17:55:13.038897 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 514/1002] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:55:13.405767 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:13.415522 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-97493e60-3e46-4a57-8589-1e58ad805539 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1760 microversion: 2.1 time: 0.481191 Jul 15 17:55:13.416204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 489/1003] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:12 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1760 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:13.639124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1697723879", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "networks": [{"uuid": "cc462d7c-1e94-40bf-81e3-59643332e44b"}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:13.692983 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] validate_networks() for [('cc462d7c-1e94-40bf-81e3-59643332e44b', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:55:14.115400 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:55:14.116437 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:55:14.116939 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:55:14.117353 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:55:14.117767 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:55:14.127727 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:14.127882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:14.128713 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:14.129151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:14.145871 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Getting quotas for project d9a1495d03fa4a76866a8784e3281a10. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:55:14.149851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Getting quotas for user 62fbd947e2a14d11b5cfeb26730347e5 and project d9a1495d03fa4a76866a8784e3281a10. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:55:14.160898 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:55:14.163885 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:55:14.615643 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a6d65dfb-4a81-4d86-9454-511b84549c08 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980765 Jul 15 17:55:14.616359 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 515/1004] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:55:14.626470 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-76a36458-7797-4adf-8bd7-b7e1651de540 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:14.627089 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-76a36458-7797-4adf-8bd7-b7e1651de540 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:14.681366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-76a36458-7797-4adf-8bd7-b7e1651de540 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:14.687184 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-76a36458-7797-4adf-8bd7-b7e1651de540 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1214 microversion: 2.1 time: 0.064806 Jul 15 17:55:14.687753 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 490/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:14 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:15.704574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:15.705336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:15.712801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:15.713242 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:15.714063 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:15.714573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:15.780225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:15.788342 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e7a53e01-2614-4574-a87d-b8d677e2deef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1218 microversion: 2.1 time: 0.087692 Jul 15 17:55:15.788945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 516/1006] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:15 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:16.805846 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:16.806484 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:16.814110 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:16.818526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:16.818526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:16.818526 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:16.881542 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:16.884838 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e82bfc64-6c46-4c40-a5b1-4b88e878685b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1210 microversion: 2.1 time: 0.083532 Jul 15 17:55:16.885406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 491/1007] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:16 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:17.901633 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:17.902277 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:17.908780 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:17.909226 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:17.909986 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:17.910421 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:17.971732 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:17.980083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f6a882f9-34d9-43bc-844b-5b8e14d15568 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1210 microversion: 2.1 time: 0.082234 Jul 15 17:55:17.980658 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 517/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:17 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:18.997005 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:18.997617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:19.004663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:19.005123 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:19.005901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:19.006345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:19.072273 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:19.079697 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3a6988ba-2926-403a-a061-883ea4d5e451 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1210 microversion: 2.1 time: 0.086570 Jul 15 17:55:19.080257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 492/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:18 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:20.097033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:20.097639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:20.104882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:20.105355 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:20.106131 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:20.106576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:20.167036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:20.174354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-518d363a-7770-4a73-8bb6-de3d14e1882b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1266 microversion: 2.1 time: 0.081173 Jul 15 17:55:20.174909 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 518/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:20 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:21.191990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:21.192517 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:21.199033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:21.199485 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:21.200253 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:21.200727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:21.262275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:21.269743 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0833a666-4f96-44bf-a5b9-a436c8542ef0 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1266 microversion: 2.1 time: 0.081767 Jul 15 17:55:21.270304 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 493/1011] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:21 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:22.287357 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:22.288172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:22.294839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:22.295289 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:22.296065 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:22.296516 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:22.359742 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:22.367196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9caa892a-95f5-472e-9f5a-9804852daeb1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1266 microversion: 2.1 time: 0.084609 Jul 15 17:55:22.367755 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 519/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:22 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:23.383421 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:23.384115 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:23.390487 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:23.395494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:23.395494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:23.395494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:23.577649 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:23.586314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-05afa05d-9eee-437d-81cf-96793e670437 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.206889 Jul 15 17:55:23.586893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 494/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:23 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:24.556921 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-04dbb272-80d1-4c1b-933e-588e741b0b5b req-9f7ae293-1e8f-4ef0-8eab-6fdd03229547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0e25f1-14c1-411e-bf13-98d43cc72732", "tag": "f109bb64-ba8a-4d2e-bde4-ed7e24af7c91"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:24.561100 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:24.561790 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=6 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:24.567349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-04dbb272-80d1-4c1b-933e-588e741b0b5b req-9f7ae293-1e8f-4ef0-8eab-6fdd03229547 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:24.567797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-04dbb272-80d1-4c1b-933e-588e741b0b5b req-9f7ae293-1e8f-4ef0-8eab-6fdd03229547 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:24.580837 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-04dbb272-80d1-4c1b-933e-588e741b0b5b req-9f7ae293-1e8f-4ef0-8eab-6fdd03229547 service nova] Creating event network-changed:f109bb64-ba8a-4d2e-bde4-ed7e24af7c91 for instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 on hv-cinder-83697 Jul 15 17:55:24.586302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-04dbb272-80d1-4c1b-933e-588e741b0b5b req-9f7ae293-1e8f-4ef0-8eab-6fdd03229547 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Jul 15 17:55:24.586895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 520/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:55:24.603248 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:24.603873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:24.611196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:24.611650 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:24.612438 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:24.612912 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:24.685307 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:24.751674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:24.759934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-323978d8-ff89-4270-a82c-f8eb6ba4e3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.160609 Jul 15 17:55:24.760426 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 495/1015] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:24 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:25.778162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:25.778865 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:25.786050 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:25.786502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:25.787863 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:25.789836 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:25.929368 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:25.936957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-2dbc9bf0-e24b-4ea4-950d-f0a9ba8634c2 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.163538 Jul 15 17:55:25.937534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 521/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:25 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:26.954064 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:26.954681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:26.961718 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:26.962166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:26.962936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:26.963375 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:27.088917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:27.096348 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2108bc6a-2e58-4e24-ab80-5a1453eafa2b tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.146125 Jul 15 17:55:27.096953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 496/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:26 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:28.114137 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:28.114748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:28.122003 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:28.122386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:28.123407 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:28.123841 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:28.253275 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:28.261336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4505fe5b-d779-4420-b7e4-551302cd5e61 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.151227 Jul 15 17:55:28.261893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 522/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:28 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:29.278528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:29.279141 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:29.285656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:29.286111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:29.286874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:29.287973 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:29.424143 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:29.431679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4df08d43-76a2-45cb-8910-3ef332a43440 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.157021 Jul 15 17:55:29.432231 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 497/1019] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:29 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:30.447778 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:30.448395 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:30.455130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:30.455581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:30.456361 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:30.456825 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:30.588525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:30.595910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-188e4c17-8574-43ff-b3bb-e47cb0d75b9f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.151920 Jul 15 17:55:30.596473 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 523/1020] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:30 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:31.613215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:31.613817 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:31.621056 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:31.621498 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:31.622256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:31.622690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:31.766219 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:31.773656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f17004ab-c156-4d52-9710-4c19f25d1a2d tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.164620 Jul 15 17:55:31.774216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 498/1021] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:31 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:32.705725 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-0503951b-6e40-496d-be31-12d7f3e78354 req-bc67b415-29ed-4880-b8d5-acec670c6aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0e25f1-14c1-411e-bf13-98d43cc72732", "name": "network-vif-plugged", "status": "completed", "tag": "f109bb64-ba8a-4d2e-bde4-ed7e24af7c91"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:32.715441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-0503951b-6e40-496d-be31-12d7f3e78354 req-bc67b415-29ed-4880-b8d5-acec670c6aca service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:32.715893 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-0503951b-6e40-496d-be31-12d7f3e78354 req-bc67b415-29ed-4880-b8d5-acec670c6aca service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:32.727971 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-0503951b-6e40-496d-be31-12d7f3e78354 req-bc67b415-29ed-4880-b8d5-acec670c6aca service nova] Creating event network-vif-plugged:f109bb64-ba8a-4d2e-bde4-ed7e24af7c91 for instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 on hv-cinder-83697 Jul 15 17:55:32.733452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-0503951b-6e40-496d-be31-12d7f3e78354 req-bc67b415-29ed-4880-b8d5-acec670c6aca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Jul 15 17:55:32.734052 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 524/1022] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:55:32.794130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:32.795504 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:32.801924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:32.802451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:32.803418 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:32.803930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:32.946804 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:32.954454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-dea6b5c3-c2a7-41ad-b82b-76294a9097c7 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.167511 Jul 15 17:55:32.955025 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 499/1023] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:32 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:33.972124 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:33.972849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:33.979768 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:33.980219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:33.981019 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:33.981486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:34.114176 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:34.122533 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-93fcccc0-a8f1-4ac5-8784-ef707bf79b40 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.154833 Jul 15 17:55:34.123344 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 525/1024] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:33 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:35.139646 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:35.140196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:35.147562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:35.148014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:35.148810 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:35.149255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:35.284796 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:35.292237 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bf9f4514-84e7-4f40-af85-cd4ed55e2e6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.156529 Jul 15 17:55:35.292822 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 500/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:35 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:36.308734 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:36.309337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:36.315984 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:36.316423 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:36.317205 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:36.317636 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:36.445671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:36.453046 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-df72fc25-b912-4b9a-9eb3-f0890adac528 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.148118 Jul 15 17:55:36.453605 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 526/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:36 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:37.470774 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:37.471397 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:37.478092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:37.481907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:37.481907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:37.481907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:37.619117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:37.626984 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2725b68c-c516-46a9-bc7f-183f1f21e5ae tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1314 microversion: 2.1 time: 0.160133 Jul 15 17:55:37.627553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 501/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:37 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:38.644931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:38.645538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:38.648020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:38.652858 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:38.653304 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:38.654068 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:38.654502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:38.658391 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=73 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:38.797036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:38.805843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f248f7f2-8eec-49cf-aaa3-688b3e724774 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1497 microversion: 2.1 time: 0.164826 Jul 15 17:55:38.806409 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 527/1028] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:38 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:39.761951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:39.762445 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:39.769068 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:39.769524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:39.770296 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:39.770738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:39.803061 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:55:40.120456 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7c508ff9-787f-418d-94bb-c5ad67c33d4e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 204 len: 0 microversion: 2.1 time: 0.361621 Jul 15 17:55:40.120456 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 502/1029] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:55:39 2022] DELETE /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:55:40.128500 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:40.129150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:40.135769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:40.136455 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:40.137308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:40.137692 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:40.271167 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:40.278839 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e15b9bca-872b-4aa4-9368-28edd5fe1000 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1503 microversion: 2.1 time: 0.154494 Jul 15 17:55:40.280773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 528/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:40 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:41.296644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:41.297371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:41.304502 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:41.305298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:41.306198 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:41.306686 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:41.440028 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:41.447740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bebcc4c3-3313-4bb1-92fa-1db07028aec5 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1503 microversion: 2.1 time: 0.155575 Jul 15 17:55:41.448524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 503/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:41 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:42.465514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:42.470870 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:42.472542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:42.473034 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:42.473784 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:42.474222 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:42.607545 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:42.615085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-60ba958d-6a62-483a-83e8-688203552a17 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1503 microversion: 2.1 time: 0.153977 Jul 15 17:55:42.615645 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 529/1032] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:42 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:43.632545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:43.633181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:43.635617 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:43.640294 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:43.640775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:43.641536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:43.641974 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:43.660217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:43.785999 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:43.793811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f2264c78-e23e-4cf7-9543-2492aff52fe1 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1503 microversion: 2.1 time: 0.164996 Jul 15 17:55:43.794486 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 504/1033] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:43 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:44.642478 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-a3586438-0417-425e-9751-2065312bf55f req-71333d10-9c86-40c1-948a-7ff6ade863d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0e25f1-14c1-411e-bf13-98d43cc72732", "name": "network-vif-deleted", "tag": "f109bb64-ba8a-4d2e-bde4-ed7e24af7c91"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:44.651606 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-a3586438-0417-425e-9751-2065312bf55f req-71333d10-9c86-40c1-948a-7ff6ade863d2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:44.658830 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-a3586438-0417-425e-9751-2065312bf55f req-71333d10-9c86-40c1-948a-7ff6ade863d2 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:44.665395 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-a3586438-0417-425e-9751-2065312bf55f req-71333d10-9c86-40c1-948a-7ff6ade863d2 service nova] Creating event network-vif-deleted:f109bb64-ba8a-4d2e-bde4-ed7e24af7c91 for instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 on hv-cinder-83697 Jul 15 17:55:44.670358 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-a3586438-0417-425e-9751-2065312bf55f req-71333d10-9c86-40c1-948a-7ff6ade863d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034484 Jul 15 17:55:44.670941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 530/1034] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:55:44.811949 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:44.812632 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:44.819977 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:44.821067 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:44.821841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:44.822279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:44.886962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:44.894875 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e46baf2d-c6ca-4813-aff8-d248954596e4 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1461 microversion: 2.1 time: 0.087552 Jul 15 17:55:44.895442 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 505/1035] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:44 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:45.502791 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:45.503424 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:45.510436 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.510882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.511663 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.512094 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.720236 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d7768e61-706c-43cb-96d4-929172567b20 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/action" status: 202 len: 0 microversion: 2.1 time: 0.223089 Jul 15 17:55:45.721171 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 531/1036] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:55:45 2022] POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:55:45.732729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:45.733405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:45.744549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.744549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.744549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.744549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.918839 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:45.923315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:45.923981 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:45.931396 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bbc132d7-2628-419e-9945-5024ffe2b0f2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.202436 Jul 15 17:55:45.932777 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.933902 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 506/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:45 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:45.943153 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.944088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.944844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.986573 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:45.987292 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:45.994277 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.994799 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:45.995667 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:45.996166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:46.022887 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:55:46.023091 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:46.033152 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-98639cea-d023-48c9-b4e2-d9662fb54c24 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1461 microversion: 2.1 time: 0.114184 Jul 15 17:55:46.034392 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 532/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:45 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:46.041050 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-606f34c7-a17c-4b9f-afc7-7681349d67b1 req-c915fd42-9f32-4a24-80f7-19fbb8599134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:46.051829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-606f34c7-a17c-4b9f-afc7-7681349d67b1 req-c915fd42-9f32-4a24-80f7-19fbb8599134 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:46.052369 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-606f34c7-a17c-4b9f-afc7-7681349d67b1 req-c915fd42-9f32-4a24-80f7-19fbb8599134 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:46.064249 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-606f34c7-a17c-4b9f-afc7-7681349d67b1 req-c915fd42-9f32-4a24-80f7-19fbb8599134 service nova] Creating event network-changed:0dad5793-1312-4eb3-912c-d33ba3dd6b43 for instance 2e8e11f1-2777-4750-9a76-49660282b01d on hv-cinder-83697 Jul 15 17:55:46.069613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-606f34c7-a17c-4b9f-afc7-7681349d67b1 req-c915fd42-9f32-4a24-80f7-19fbb8599134 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 Jul 15 17:55:46.070844 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 533/1039] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:55:46.288385 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-644de763-ccdb-417e-8618-d6ca22f0ae50 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 204 len: 0 microversion: 2.1 time: 0.305988 Jul 15 17:55:46.289280 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 507/1040] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:55:45 2022] DELETE /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 15 17:55:46.297789 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:46.298493 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:46.306439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:46.307498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:46.307674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:46.308669 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:46.449930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:46.457678 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-17cd8c8c-e706-4cf3-931d-87d13b3e8d83 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.164074 Jul 15 17:55:46.458241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 534/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:46 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:46.951422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:46.952694 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:46.959257 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:46.959708 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:46.960711 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:46.961155 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:47.050328 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:47.050935 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:47.057991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:47.058441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:47.059212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:47.059655 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:47.109021 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:47.117854 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f1ede75a-753b-4e58-8f0c-977db6826117 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.170219 Jul 15 17:55:47.118435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 508/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:46 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:47.133204 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:47.140744 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-813d9b60-80fe-43c0-b3fb-24689cf32b6c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1461 microversion: 2.1 time: 0.094102 Jul 15 17:55:47.141306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 535/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:47 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1461 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:47.475426 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:47.475954 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:47.489871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:47.490144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:47.490812 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:47.492085 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:47.654962 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:47.663536 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e439863b-9b96-4fe0-bd2d-4525ce68af9d tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.192065 Jul 15 17:55:47.664915 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 509/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:47 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:48.136349 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:48.136989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:48.143488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.143942 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.144737 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.149210 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.158306 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:48.159011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:48.165084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.165787 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.166825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.167428 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.205314 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.205721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.206175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lazy-loading 'fault' on Instance uuid 8f0e25f1-14c1-411e-bf13-98d43cc72732 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:48.250712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:48.258343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-316176d5-82ca-413b-a620-617cb384d046 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1304 microversion: 2.1 time: 0.104534 Jul 15 17:55:48.259011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 510/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:48 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:48.301957 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:48.312151 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-dc496644-f869-44fd-8fca-3f0626a4dfe3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.180038 Jul 15 17:55:48.312843 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 536/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:48 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:48.681033 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:48.681656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:48.687629 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.688077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.688869 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:48.689307 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:48.934542 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:48.942452 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c7f0ad82-fc51-4d84-9cba-a4a48959c1cf tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.265438 Jul 15 17:55:48.943038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 511/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:48 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:49.276006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:49.276634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:49.283247 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.283693 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:49.284456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.284922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:49.317269 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.317718 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:49.318161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lazy-loading 'fault' on Instance uuid 8f0e25f1-14c1-411e-bf13-98d43cc72732 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:49.329502 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:49.330119 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:49.336881 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.337661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:49.338701 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.339643 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:49.359006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:49.366488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-973609ff-0934-46ee-87a5-5f063403f3d9 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1304 microversion: 2.1 time: 0.094995 Jul 15 17:55:49.367313 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 537/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:49 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:49.503422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:49.512273 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6e5fd0d9-36a2-4862-937c-f1c91889e834 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.186653 Jul 15 17:55:49.512886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 512/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:49 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:49.959063 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:49.959762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:49.965861 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.966386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:49.967220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:49.967748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:50.112331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:50.120351 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0bcb7d6e-b75c-42ce-aefb-20a8146a9aef tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.165096 Jul 15 17:55:50.121028 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 538/1050] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:49 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:50.387076 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:50.387714 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:50.395300 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:50.395750 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:50.396534 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:50.396985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:50.430522 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:50.431018 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:50.433373 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lazy-loading 'fault' on Instance uuid 8f0e25f1-14c1-411e-bf13-98d43cc72732 {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:50.477366 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:50.484985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8edbc265-2d34-4682-b674-02d6870d6402 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1304 microversion: 2.1 time: 0.101898 Jul 15 17:55:50.493007 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 513/1051] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:50 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:50.530064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:50.530780 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:50.537524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:50.537978 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:50.538743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:50.539180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:50.684084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:50.692239 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7db79b0c-1ee4-4a3d-82e8-7ed97a0b3881 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.166129 Jul 15 17:55:50.692834 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 539/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:50 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:51.142000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:51.142611 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:51.148626 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.149084 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.149840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.150267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.296178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:51.303994 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-93728238-bb56-4c32-92c4-a41a33d961a4 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.166273 Jul 15 17:55:51.304530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 514/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:51 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:51.502140 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:51.502800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:51.508753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.509197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.509962 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.510422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.541266 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.542185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.542185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lazy-loading 'fault' on Instance uuid 8f0e25f1-14c1-411e-bf13-98d43cc72732 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:51.591315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:51.598884 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-114633e6-0366-48e5-8e0d-c46b72dcf497 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 200 len: 1304 microversion: 2.1 time: 0.100715 Jul 15 17:55:51.599446 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 540/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:51 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:51.709387 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:51.711037 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:51.717789 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.718238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.719011 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:51.719447 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:51.864327 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:51.873725 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ccd61c1e-ae18-474a-8c32-922be387d77c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.168210 Jul 15 17:55:51.874745 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 515/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:51 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:52.320825 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:52.321544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:52.328070 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:52.328543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:52.329327 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:52.329765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:52.488584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:52.497654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-fbd87306-8653-4c5d-b39c-26c07dc81c59 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1568 microversion: 2.1 time: 0.180342 Jul 15 17:55:52.499416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 541/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:52 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:52.617135 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:52.617816 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 8f0e25f1-14c1-411e-bf13-98d43cc72732] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:52.624997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:52.625450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:52.626225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:52.626668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:52.641163 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] HTTP exception thrown: Instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 could not be found. Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Request method failure captured: Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 HTTP/1.1 Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0an_I-9aAEO_qhUpP9QaGUj8t5M1DO_DngjWz6-6cJ9Wn-WjmAK7w73FWNUjPQ7-c5xYebn_e-CBsg91L0jRxp2KRhFZrNQv5kdu2xlqpC0fJ9K53fCKhT9ITs1gf9U1KTWYrL83fehcXw0ZE-y4IJQ2qneF_HWHV6YFShpXY-4FLSk Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d9a1495d03fa4a76866a8784e3281a10 Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesActionsTest-741850562 Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:55:52.647961 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9a1495d03fa4a76866a8784e3281a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9a1495d03fa4a76866a8784e3281a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9a1495d03fa4a76866a8784e3281a10", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9a1495d03fa4a76866a8784e3281a10"}]}] Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesActionsTest-741850562 Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d9a1495d03fa4a76866a8784e3281a10 Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesActionsTest-741850562 Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesActionsTest-741850562-project Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 62fbd947e2a14d11b5cfeb26730347e5 Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesActionsTest-741850562-project Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 could not be found. Jul 15 17:55:52.649569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '8f0e25f1-14c1-411e-bf13-98d43cc72732'} Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 could not be found. Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:55:52.650469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 could not be found. Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 could not be found. Jul 15 17:55:52.651801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:52.653664 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Returning 404 to user: Instance 8f0e25f1-14c1-411e-bf13-98d43cc72732 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:55:52.653664 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-aeff6386-b015-4043-8df2-ff1504d3710f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732" status: 404 len: 111 microversion: 2.1 time: 0.031019 Jul 15 17:55:52.653664 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 516/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:52 2022] GET /compute/v2.1/servers/8f0e25f1-14c1-411e-bf13-98d43cc72732 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:55:52.772278 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1212201092", "imageRef": "7ca0ddf7-97d3-4258-a4e2-46422b8b623b", "flavorRef": "452", "networks": [{"uuid": "cc462d7c-1e94-40bf-81e3-59643332e44b"}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:52.835199 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] validate_networks() for [('cc462d7c-1e94-40bf-81e3-59643332e44b', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:55:52.892534 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:52.893378 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:52.901464 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:52.903568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:52.903568 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:52.903812 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:53.110046 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:53.119831 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5a706798-64cf-4c86-95a5-878188ed24c3 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1752 microversion: 2.1 time: 0.232423 Jul 15 17:55:53.129890 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 517/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:52 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:53.222951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-1e4ac0ef-8720-4b49-9744-82bba03487ca req-1c8c8a55-cb88-48cb-8c60-4028f10ea59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8e11f1-2777-4750-9a76-49660282b01d", "name": "network-vif-deleted", "tag": "0dad5793-1312-4eb3-912c-d33ba3dd6b43"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:55:53.235904 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-1e4ac0ef-8720-4b49-9744-82bba03487ca req-1c8c8a55-cb88-48cb-8c60-4028f10ea59e service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:53.236345 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-1e4ac0ef-8720-4b49-9744-82bba03487ca req-1c8c8a55-cb88-48cb-8c60-4028f10ea59e service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:53.251884 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-1e4ac0ef-8720-4b49-9744-82bba03487ca req-1c8c8a55-cb88-48cb-8c60-4028f10ea59e service nova] Creating event network-vif-deleted:0dad5793-1312-4eb3-912c-d33ba3dd6b43 for instance 2e8e11f1-2777-4750-9a76-49660282b01d on hv-cinder-83697 Jul 15 17:55:53.257285 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-1e4ac0ef-8720-4b49-9744-82bba03487ca req-1c8c8a55-cb88-48cb-8c60-4028f10ea59e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038039 Jul 15 17:55:53.258054 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 518/1059] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:55:53.273043 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:55:53.273418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:55:53.274030 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:55:53.274275 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:55:53.274679 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:55:53.284750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:53.285202 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:53.286012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:53.286450 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:53.303819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Getting quotas for project d9a1495d03fa4a76866a8784e3281a10. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:55:53.307908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Getting quotas for user 62fbd947e2a14d11b5cfeb26730347e5 and project d9a1495d03fa4a76866a8784e3281a10. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:55:53.319214 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:55:53.321502 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ca0ddf7-97d3-4258-a4e2-46422b8b623b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:55:53.516507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:53.517252 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:53.521150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f2862513-96f1-4945-b65c-2ad6255c5918 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755273 Jul 15 17:55:53.525890 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 542/1060] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:55:53.526966 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:53.533159 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:53.534856 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:53.535223 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4a506c36-c461-4850-8038-fa0210bb6769 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:53.535339 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:53.536285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4a506c36-c461-4850-8038-fa0210bb6769 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:53.612354 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4a506c36-c461-4850-8038-fa0210bb6769 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:53.628209 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4a506c36-c461-4850-8038-fa0210bb6769 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1214 microversion: 2.1 time: 0.097719 Jul 15 17:55:53.637114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 543/1061] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:53 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:53.642704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:53.651845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-825157f4-c9fd-4104-9f73-f5147f055845 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1220 microversion: 2.1 time: 0.139627 Jul 15 17:55:53.652971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 519/1062] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:53 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:54.138966 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:54.139584 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:54.148302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.152969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.152969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.152969 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.309662 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:54.318006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4f2a572d-dcf2-4133-9127-bdc6a2c17b6e tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.184485 Jul 15 17:55:54.318903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 544/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:54 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:54.645275 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:54.646134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:54.654140 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.654740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.655506 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.657264 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.660328 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:54.669962 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:54.674561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:54.678595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.679038 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.679832 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.680262 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.683045 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:54.713611 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:54.714179 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:54.714698 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lazy-loading 'fault' on Instance uuid 2e8e11f1-2777-4750-9a76-49660282b01d {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:54.719338 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:54.726762 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fe3df564-1db6-464c-825d-a6cc592acb2c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1218 microversion: 2.1 time: 0.085266 Jul 15 17:55:54.727341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 520/1064] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:54 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:54.761464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:54.771074 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-414f16f2-b9a2-4a90-b78f-15b65059312f tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1225 microversion: 2.1 time: 0.105278 Jul 15 17:55:54.771866 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 545/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:54 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:55.338593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:55.341410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:55.345966 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.346420 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.347195 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.347638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.491406 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:55.500214 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-80cc9210-14ba-4867-a625-2a7753a6d07a tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.165867 Jul 15 17:55:55.500827 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 521/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:55 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:55.745463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:55.746025 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:55.753233 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.753688 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.754485 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.754924 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.789223 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:55.789849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:55.798206 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.798891 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.800804 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.801608 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.828469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:55.837081 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0b57ff33-d241-41fa-a39a-de3d4c21e40f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1218 microversion: 2.1 time: 0.096710 Jul 15 17:55:55.837326 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:55.837738 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:55.838114 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 546/1067] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:55 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:55.838598 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lazy-loading 'fault' on Instance uuid 2e8e11f1-2777-4750-9a76-49660282b01d {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:55.885620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:55.893238 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a9a37f5b-be88-4789-ad26-0991bcddb713 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1225 microversion: 2.1 time: 0.108162 Jul 15 17:55:55.894023 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 522/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:55 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:56.517813 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:56.518413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:56.524436 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.529031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.529031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.529031 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.670974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:56.679917 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0fbe1026-40cf-4da3-a094-f2acb6be3437 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.165265 Jul 15 17:55:56.684018 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 547/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:56 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:56.856649 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:56.856649 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:56.862169 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.862169 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.862953 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.863394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.909225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:56.909876 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:56.917064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.919829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.919829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.919829 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.930242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:56.940815 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f03febb4-b4e9-4d17-8d25-ba14e52b5733 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1218 microversion: 2.1 time: 0.090509 Jul 15 17:55:56.942941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 523/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:56 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:56.954418 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:56.954867 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:56.955347 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lazy-loading 'fault' on Instance uuid 2e8e11f1-2777-4750-9a76-49660282b01d {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:55:56.999557 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87a32eb7afd4eb5ae5c6cdbf06c65d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4d85b85edb4aa3b18b88ae45c3b702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:57.007024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-01d55738-7ba6-47df-924c-61c28f299b26 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 200 len: 1225 microversion: 2.1 time: 0.101631 Jul 15 17:55:57.007583 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 548/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:56 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:57.699065 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:57.700042 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:57.706776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:57.707225 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:57.708001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:57.708549 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:57.868163 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:57.879668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-bce502ce-8821-4d96-98a7-e3aa8b5c08eb tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.185023 Jul 15 17:55:57.880838 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 524/1072] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:57 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:57.960931 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:57.961561 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:57.973309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:57.973569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:57.975134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:57.975589 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:58.024368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:58.025653 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] [instance: 2e8e11f1-2777-4750-9a76-49660282b01d] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:58.032654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:58.037044 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:58.038217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:58.038825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:58.058398 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:58.067392 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] HTTP exception thrown: Instance 2e8e11f1-2777-4750-9a76-49660282b01d could not be found. Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Request method failure captured: Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d HTTP/1.1 Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0ajlPjF5TsIS3Cw2EPN5Y6c2Co96uUUR0B3CCU6se-cjSnzZaC7lLDRtoaOQXNQQCAtbAIb4cSpaD-ZQVUg5z_jjiJYczx4UllTXwSZelJtOZeD1Ca9FmRVzhmCsDqA6pt_AOSAViaLsxZlvK2QZ54EKeS6T6g5eGa7RycwjjIA1JTE Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: 8d4d85b85edb4aa3b18b88ae45c3b702 Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-TestShelveInstance-786615297 Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:55:58.072269 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4d85b85edb4aa3b18b88ae45c3b702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4d85b85edb4aa3b18b88ae45c3b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4d85b85edb4aa3b18b88ae45c3b702", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4d85b85edb4aa3b18b88ae45c3b702"}]}] Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-TestShelveInstance-786615297 Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: 8d4d85b85edb4aa3b18b88ae45c3b702 Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-TestShelveInstance-786615297 Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-TestShelveInstance-786615297-project Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: e87a32eb7afd4eb5ae5c6cdbf06c65d1 Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-TestShelveInstance-786615297-project Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 2e8e11f1-2777-4750-9a76-49660282b01d could not be found. Jul 15 17:55:58.073956 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '2e8e11f1-2777-4750-9a76-49660282b01d'} Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8e11f1-2777-4750-9a76-49660282b01d could not be found. Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:55:58.075058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8e11f1-2777-4750-9a76-49660282b01d could not be found. Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8e11f1-2777-4750-9a76-49660282b01d could not be found. Jul 15 17:55:58.076471 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:55:58.080878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Returning 404 to user: Instance 2e8e11f1-2777-4750-9a76-49660282b01d could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:55:58.080878 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e14001e9-9c64-46f8-a1df-e441a48ae646 tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d" status: 404 len: 111 microversion: 2.1 time: 0.059894 Jul 15 17:55:58.081463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 525/1073] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:58 2022] GET /compute/v2.1/servers/2e8e11f1-2777-4750-9a76-49660282b01d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:55:58.086263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a4116577-7447-4add-af38-658140881209 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1274 microversion: 2.1 time: 0.130724 Jul 15 17:55:58.087798 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 549/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:57 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:55:58.396092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-67b1fa36-ff3e-4470-bd84-d0e6f9569a6a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] Calling method '.version_select at 0x7f37d1351040>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:58.478321 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-67b1fa36-ff3e-4470-bd84-d0e6f9569a6a tempest-TestShelveInstance-786615297 tempest-TestShelveInstance-786615297-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000020415" status: 202 len: 0 microversion: 2.1 time: 0.086177 Jul 15 17:55:58.480430 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 526/1075] 10.222.0.57 () {58 vars in 1253 bytes} [Fri Jul 15 17:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000020415 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:55:58.903374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:58.904321 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:58.910574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:58.911509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:58.911927 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:58.912419 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:59.106771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:55:59.107374 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:55:59.116472 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:59.116988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:59.117829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:55:59.118283 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:55:59.268673 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:59.277905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0325aafb-c381-42b9-91f0-42bd6c6b7f73 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.378573 Jul 15 17:55:59.285387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 550/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:58 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:55:59.300523 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:55:59.309931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3bc9cf05-6db2-4754-904e-3bcbeda6757e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.209124 Jul 15 17:55:59.311370 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 527/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:55:59 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:56:00.196084 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-e3799b4f-0749-4100-9fe5-4652442fecf0 req-5af05bb5-eb48-4b9c-8a5c-d545fbb31125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486c1d13-8964-443e-a9a0-247a21a397fd", "tag": "256506a2-e197-42e5-858b-584e96a2de43"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:00.206674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-e3799b4f-0749-4100-9fe5-4652442fecf0 req-5af05bb5-eb48-4b9c-8a5c-d545fbb31125 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:00.207427 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-e3799b4f-0749-4100-9fe5-4652442fecf0 req-5af05bb5-eb48-4b9c-8a5c-d545fbb31125 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:00.221188 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-e3799b4f-0749-4100-9fe5-4652442fecf0 req-5af05bb5-eb48-4b9c-8a5c-d545fbb31125 service nova] Creating event network-changed:256506a2-e197-42e5-858b-584e96a2de43 for instance 486c1d13-8964-443e-a9a0-247a21a397fd on hv-cinder-83697 Jul 15 17:56:00.230953 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-e3799b4f-0749-4100-9fe5-4652442fecf0 req-5af05bb5-eb48-4b9c-8a5c-d545fbb31125 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044060 Jul 15 17:56:00.245085 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 551/1078] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:56:00.310469 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:00.311153 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:00.321950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:00.322770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:00.323837 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:00.324439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:00.337771 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:00.340994 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:00.350161 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:00.351370 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:00.353670 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:00.354401 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:00.592451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:00.602552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-16e56877-cf92-4efa-b66c-05a7c4fe2bcf tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.296503 Jul 15 17:56:00.604678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 528/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:00 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:00.629348 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:00.643263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a37f038e-a6f1-466a-9cfe-48bcb2aa214e tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.312059 Jul 15 17:56:00.644285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 552/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:00 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:01.623075 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:01.623704 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:01.630391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:01.630853 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:01.631692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:01.632186 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:01.665288 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:01.666112 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:01.676696 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:01.677254 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:01.678138 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:01.678674 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:01.795152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:01.803372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-79994cd1-e0f4-4cd1-8975-e72eac7806c2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.186471 Jul 15 17:56:01.803951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 529/1081] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:01 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:01.884071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:01.893805 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1392a8a8-9446-4859-953f-be3da501ddef tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.233795 Jul 15 17:56:01.894573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 553/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:01 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:02.821179 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:02.821814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:02.829425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:02.829893 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:02.831013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:02.831636 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:02.914310 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:02.914908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:02.922822 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:02.923315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:02.924080 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:02.924715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:03.082668 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:03.091211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6970b390-3783-4bbb-84f0-70485ca1949c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.180750 Jul 15 17:56:03.091779 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 554/1083] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:02 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:56:03.143835 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:03.152778 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-f1d893b9-c7ff-4556-ab7f-fd35f4fe944c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.335429 Jul 15 17:56:03.153510 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 530/1084] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:02 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:04.108250 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:04.108991 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:04.118090 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:04.123647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=8 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:04.128251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:04.131134 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:04.132165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:04.136014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:04.172184 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:04.174187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:04.187394 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:04.189039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:04.189964 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:04.190619 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:04.393061 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:04.402576 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-83aaa0df-41a9-4881-b6b3-10ce17e0ca3c tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.298362 Jul 15 17:56:04.403405 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 555/1085] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:04 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:04.519422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:04.528654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-a69a00c7-a41c-41bf-8fcc-ae305da61e33 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.362346 Jul 15 17:56:04.529242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 531/1086] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:04 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:56:05.420382 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:05.421797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:05.433936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:05.437123 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:05.438524 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:05.439267 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:05.546749 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:05.547200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:05.554931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:05.555460 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:05.556303 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:05.556850 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:05.602486 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:05.610834 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8c5a38fc-447e-49d4-b36a-30a4ccc2a4e8 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.194177 Jul 15 17:56:05.612285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 556/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:05 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:05.782758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:05.792440 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3826436a-0281-46ec-979b-c5c07dd9aba4 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.250012 Jul 15 17:56:05.793415 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 532/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:05 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:06.230065 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-b2b81d7b-e052-4fb3-b0f4-3ebc8946c950 req-bf9de917-33d3-47a4-90e1-8627b0ef010b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486c1d13-8964-443e-a9a0-247a21a397fd", "name": "network-vif-plugged", "status": "completed", "tag": "256506a2-e197-42e5-858b-584e96a2de43"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:06.238960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-b2b81d7b-e052-4fb3-b0f4-3ebc8946c950 req-bf9de917-33d3-47a4-90e1-8627b0ef010b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:06.238960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-b2b81d7b-e052-4fb3-b0f4-3ebc8946c950 req-bf9de917-33d3-47a4-90e1-8627b0ef010b service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:06.251694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-b2b81d7b-e052-4fb3-b0f4-3ebc8946c950 req-bf9de917-33d3-47a4-90e1-8627b0ef010b service nova] Creating event network-vif-plugged:256506a2-e197-42e5-858b-584e96a2de43 for instance 486c1d13-8964-443e-a9a0-247a21a397fd on hv-cinder-83697 Jul 15 17:56:06.257167 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-b2b81d7b-e052-4fb3-b0f4-3ebc8946c950 req-bf9de917-33d3-47a4-90e1-8627b0ef010b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033944 Jul 15 17:56:06.257812 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 557/1089] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:06.633279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:06.633982 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:06.640801 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:06.641256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:06.642032 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:06.642467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:06.796183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:06.807671 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-872b7acc-6e00-4407-819c-2585ba6b4b3f tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.178186 Jul 15 17:56:06.811842 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:06.813387 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:06.817770 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 533/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:06 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:06.821883 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:06.822413 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:06.823265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:06.823895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:07.341103 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:07.349330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-721eb36a-07f4-406d-b704-27eaed3238f1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.542372 Jul 15 17:56:07.349899 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 558/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:06 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:56:07.823981 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:07.824642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:07.831679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:07.832134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:07.832930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:07.833371 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:07.966539 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:07.974845 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-e7b7bccc-68f6-4140-bdc0-d12883374b42 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1314 microversion: 2.1 time: 0.154783 Jul 15 17:56:07.975423 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 534/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:07 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:08.365661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:08.366521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:08.373388 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:08.373863 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:08.374624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:08.375055 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:08.527017 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:08.535627 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-4f740f7c-1c94-4fdb-8b70-a852a9488589 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1757 microversion: 2.1 time: 0.173781 Jul 15 17:56:08.536318 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 559/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:08 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:08.991578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:08.992263 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:08.999793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:09.000234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:09.001038 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:09.001496 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:09.147720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:09.155399 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8060db13-7c9f-4a01-97b6-3b86fe558b34 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1498 microversion: 2.1 time: 0.167858 Jul 15 17:56:09.155971 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 535/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:08 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:09.553657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:09.558104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:09.562142 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:09.562946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:09.563731 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:09.564165 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:09.722190 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:09.730875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-6f9e0bd0-012c-40bb-b7b4-fa58ce838fbe tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1760 microversion: 2.1 time: 0.181453 Jul 15 17:56:09.731590 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 560/1095] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:09 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:10.126907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:10.127425 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:10.134556 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:10.135006 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:10.135775 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:10.136212 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:10.161324 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:56:10.247522 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:10.356196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-00de0f61-5993-4cfe-9b0e-03fbfa129479 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "DELETE /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 204 len: 0 microversion: 2.1 time: 0.232808 Jul 15 17:56:10.356840 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 536/1096] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:56:10 2022] DELETE /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:56:10.365306 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:10.365999 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:10.368522 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:10.373568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:10.373988 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:10.374929 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:10.375265 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:10.506023 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:10.514323 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c6e2dcbd-f757-4446-93fe-55a15d2edcba tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1504 microversion: 2.1 time: 0.152892 Jul 15 17:56:10.514900 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 561/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:10 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:11.531950 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:11.532572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:11.539001 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:11.539453 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:11.540758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:11.541200 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:11.673604 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:11.681906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-72e35c13-5bb6-4cf4-8844-7044a2038345 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1504 microversion: 2.1 time: 0.154307 Jul 15 17:56:11.682467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 537/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:11 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:12.699187 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:12.699727 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:12.706721 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:12.706976 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:12.707743 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:12.708172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:12.724432 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-7ca1426a-65a5-4fdc-ab8b-de4c75acb845 req-69fc4f3a-5cce-47e9-a56e-7aa7d6033f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486c1d13-8964-443e-a9a0-247a21a397fd", "name": "network-vif-deleted", "tag": "256506a2-e197-42e5-858b-584e96a2de43"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:12.728006 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=100 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:12.737515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-7ca1426a-65a5-4fdc-ab8b-de4c75acb845 req-69fc4f3a-5cce-47e9-a56e-7aa7d6033f03 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:12.755117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-7ca1426a-65a5-4fdc-ab8b-de4c75acb845 req-69fc4f3a-5cce-47e9-a56e-7aa7d6033f03 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:12.755117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-7ca1426a-65a5-4fdc-ab8b-de4c75acb845 req-69fc4f3a-5cce-47e9-a56e-7aa7d6033f03 service nova] Creating event network-vif-deleted:256506a2-e197-42e5-858b-584e96a2de43 for instance 486c1d13-8964-443e-a9a0-247a21a397fd on hv-cinder-83697 Jul 15 17:56:12.755117 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-7ca1426a-65a5-4fdc-ab8b-de4c75acb845 req-69fc4f3a-5cce-47e9-a56e-7aa7d6033f03 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037675 Jul 15 17:56:12.755564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 538/1099] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:12.785453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fbd947e2a14d11b5cfeb26730347e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9a1495d03fa4a76866a8784e3281a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:12.789629 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9e3f4406-09b1-4402-b886-6964ede7ba48 tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 200 len: 1462 microversion: 2.1 time: 0.094357 Jul 15 17:56:12.790796 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 562/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:12 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:13.808687 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:13.809401 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] [instance: 486c1d13-8964-443e-a9a0-247a21a397fd] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:13.817538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:13.817990 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:13.819193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:13.819978 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:13.835355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] HTTP exception thrown: Instance 486c1d13-8964-443e-a9a0-247a21a397fd could not be found. Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Request method failure captured: Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd HTTP/1.1 Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0an_I-9aAEO_qhUpP9QaGUj8t5M1DO_DngjWz6-6cJ9Wn-WjmAK7w73FWNUjPQ7-c5xYebn_e-CBsg91L0jRxp2KRhFZrNQv5kdu2xlqpC0fJ9K53fCKhT9ITs1gf9U1KTWYrL83fehcXw0ZE-y4IJQ2qneF_HWHV6YFShpXY-4FLSk Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d9a1495d03fa4a76866a8784e3281a10 Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-VolumesActionsTest-741850562 Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:56:13.837752 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9a1495d03fa4a76866a8784e3281a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9a1495d03fa4a76866a8784e3281a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9a1495d03fa4a76866a8784e3281a10", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9a1495d03fa4a76866a8784e3281a10"}]}] Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-VolumesActionsTest-741850562 Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d9a1495d03fa4a76866a8784e3281a10 Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-VolumesActionsTest-741850562 Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-VolumesActionsTest-741850562-project Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 62fbd947e2a14d11b5cfeb26730347e5 Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-VolumesActionsTest-741850562-project Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 486c1d13-8964-443e-a9a0-247a21a397fd could not be found. Jul 15 17:56:13.839295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '486c1d13-8964-443e-a9a0-247a21a397fd'} Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486c1d13-8964-443e-a9a0-247a21a397fd could not be found. Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:56:13.840142 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486c1d13-8964-443e-a9a0-247a21a397fd could not be found. Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486c1d13-8964-443e-a9a0-247a21a397fd could not be found. Jul 15 17:56:13.846349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:56:13.848166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] Returning 404 to user: Instance 486c1d13-8964-443e-a9a0-247a21a397fd could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:56:13.848166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-377ca016-4afe-454b-887b-6cc4ae90ddec tempest-VolumesActionsTest-741850562 tempest-VolumesActionsTest-741850562-project] 10.222.0.57 "GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd" status: 404 len: 111 microversion: 2.1 time: 0.035540 Jul 15 17:56:13.848166 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 539/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:13 2022] GET /compute/v2.1/servers/486c1d13-8964-443e-a9a0-247a21a397fd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:56:48.516010 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1486056178"}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:48.516730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:48.528894 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:48.531219 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:48.531895 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:48.533027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:48.533682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:48.718987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.network.security_group_api [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Removing security group fd1c1811-0995-465d-a362-eea490547a9e from port 9fc7d179-ebd6-4dcb-bbff-283282b30071 Jul 15 17:56:49.260833 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d2aae5f9-d32f-4eb0-a532-27f2a7a09eda tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/action" status: 202 len: 0 microversion: 2.1 time: 0.749928 Jul 15 17:56:49.261460 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 563/1102] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 15 17:56:48 2022] POST /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:56:49.285824 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-0c71611d-d9dc-4c40-b2ff-d98c7786355d req-6567cbe7-1b3d-4a13-8c09-c3dc65747466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:49.293799 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:49.296880 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:56:49.309256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-0c71611d-d9dc-4c40-b2ff-d98c7786355d req-6567cbe7-1b3d-4a13-8c09-c3dc65747466 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:49.312459 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-0c71611d-d9dc-4c40-b2ff-d98c7786355d req-6567cbe7-1b3d-4a13-8c09-c3dc65747466 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:49.341965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-0c71611d-d9dc-4c40-b2ff-d98c7786355d req-6567cbe7-1b3d-4a13-8c09-c3dc65747466 service nova] Creating event network-changed:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:56:49.354361 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-0c71611d-d9dc-4c40-b2ff-d98c7786355d req-6567cbe7-1b3d-4a13-8c09-c3dc65747466 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073371 Jul 15 17:56:49.357753 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 540/1103] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:50.991961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:50.992670 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:51.007879 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:51.008694 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:51.011283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:51.011283 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:51.205676 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lazy-loading 'services' on Instance uuid cab8c36a-4919-4819-9ccd-de2c2a23e83f {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:56:51.390316 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-fb0661d7-11da-461c-8562-04bdf001e346 req-af242dfa-a5d4-44a8-92f5-f52c155ce961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:51.434537 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-fb0661d7-11da-461c-8562-04bdf001e346 req-af242dfa-a5d4-44a8-92f5-f52c155ce961 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:51.435656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-fb0661d7-11da-461c-8562-04bdf001e346 req-af242dfa-a5d4-44a8-92f5-f52c155ce961 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:51.459759 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-fb0661d7-11da-461c-8562-04bdf001e346 req-af242dfa-a5d4-44a8-92f5-f52c155ce961 service nova] Creating event network-changed:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:56:51.479742 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-fb0661d7-11da-461c-8562-04bdf001e346 req-af242dfa-a5d4-44a8-92f5-f52c155ce961 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095732 Jul 15 17:56:51.496204 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 541/1104] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:51.529546 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9af78f95-dd21-4cb1-8ad4-4d2cdae4885b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments/5250d57f-4738-43dc-b1d2-73813fda02d4" status: 202 len: 0 microversion: 2.1 time: 0.544174 Jul 15 17:56:51.530572 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 564/1105] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:56:50 2022] DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments/5250d57f-4738-43dc-b1d2-73813fda02d4 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 17:56:51.546337 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:51.550501 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:51.563813 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:51.564450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:51.565509 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:51.566266 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:51.632226 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9fecaba2-dbea-4c42-8672-b157f7d99160 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096589 Jul 15 17:56:51.633461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 542/1106] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:56:51 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:52.645851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:52.647707 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:52.657882 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:52.662268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:52.662268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:52.662268 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:52.712630 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-244a4b21-4713-41dd-8970-7dd4eb894f51 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071303 Jul 15 17:56:52.720062 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 565/1107] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:56:52 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 15 17:56:53.727476 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:53.728439 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:53.735874 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:53.736325 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:53.737140 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:53.737572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:53.779065 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5e659a2d-d6ba-4d12-b1b2-1707a600c03c tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055753 Jul 15 17:56:53.780973 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 543/1108] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 15 17:56:53 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 15 17:56:53.791622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:53.792960 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:53.800946 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:53.801488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:53.802390 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:53.802898 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:53.889943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] HTTP exception thrown: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f is not attached to volume 5250d57f-4738-43dc-b1d2-73813fda02d4 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Request method failure captured: Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments/5250d57f-4738-43dc-b1d2-73813fda02d4 HTTP/1.1 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0am-CNlSU-mmjssPwUPI_IQi-LR8ggj6OWqMnDAmF9jDs8emKxnn08Xl41-1eY3qFmX57XgCZFUgo7royA-SOM42W5hgj-uC1xuF4k4g78sR0cbKPku7oHy7mBAm4prWu8ko0xl6E98efNGhiYPh5gHKpuP2NBQgkNHR0FmMJXvYors Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 08c91c6b348e4840939870bf231d5a91 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-TestMinimumBasicScenario-1602563899 Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:56:53.892654 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08c91c6b348e4840939870bf231d5a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08c91c6b348e4840939870bf231d5a91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08c91c6b348e4840939870bf231d5a91", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08c91c6b348e4840939870bf231d5a91"}]}] Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-TestMinimumBasicScenario-1602563899 Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 08c91c6b348e4840939870bf231d5a91 Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1602563899 Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-TestMinimumBasicScenario-1602563899-project Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 98b93d5a1e5b4c46b505cdacf707ee1a Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-TestMinimumBasicScenario-1602563899-project Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:56:53.894447 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f is not attached to volume 5250d57f-4738-43dc-b1d2-73813fda02d4 Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'server_id': 'cab8c36a-4919-4819-9ccd-de2c2a23e83f', 'id': '5250d57f-4738-43dc-b1d2-73813fda02d4'} Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5250d57f-4738-43dc-b1d2-73813fda02d4. Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:56:53.895298 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f is not attached to volume 5250d57f-4738-43dc-b1d2-73813fda02d4 Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f is not attached to volume 5250d57f-4738-43dc-b1d2-73813fda02d4 Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:56:53.896624 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Returning 404 to user: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f is not attached to volume 5250d57f-4738-43dc-b1d2-73813fda02d4 {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:56:53.897596 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-9b30e531-129c-401f-a2f1-887128742fdd tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments/5250d57f-4738-43dc-b1d2-73813fda02d4" status: 404 len: 154 microversion: 2.1 time: 0.107466 Jul 15 17:56:53.897596 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 566/1109] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 15 17:56:53 2022] DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f/os-volume_attachments/5250d57f-4738-43dc-b1d2-73813fda02d4 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:56:54.386679 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7fd39cb6-5eac-4825-97c0-41514196fda1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Action: 'create', calling method: .version_select at 0x7f37d150b550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-353692788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErT8Styefp2M5pQ3yaw6Hcss87fV3LxXSLI+8ui0DrvAAEFxibx7qTHcAC9O1Xzcxpt6VLjngrZyO2Ft0MailW+B6ljImEOXSiHBs+tD6ISNrwU3equtzicyxlI9dWvMQ=="}} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:54.400349 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-7fd39cb6-5eac-4825-97c0-41514196fda1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for project d8dad396aa934856a2d92c7acd786882. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:56:54.404095 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.quota [None req-7fd39cb6-5eac-4825-97c0-41514196fda1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for user 8bc160d6807b4c7daf447ea9837de3f8 and project d8dad396aa934856a2d92c7acd786882. Resources: {'key_pairs'} {{(pid=124745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:56:54.479951 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7fd39cb6-5eac-4825-97c0-41514196fda1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.292384 Jul 15 17:56:54.480066 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 544/1110] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 15 17:56:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:55.161908 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:55.162465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:55.169463 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:55.169915 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:55.170693 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:55.171127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:55.205020 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:56:55.602786 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5dd576ff-6a95-49df-97e7-a522f26ecfd2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 204 len: 0 microversion: 2.1 time: 0.444936 Jul 15 17:56:55.608003 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 567/1111] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:56:55 2022] DELETE /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:56:55.612062 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:55.612709 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:55.620128 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:55.620582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:55.621642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:55.622090 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:55.766589 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:55.774843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7e4fd45e-50fa-47bb-8742-969277857ea7 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1555 microversion: 2.1 time: 0.167107 Jul 15 17:56:55.775459 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 545/1112] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:55 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:56.793112 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:56.793875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:56.800653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:56.801125 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:56.801911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:56.802348 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:56.948174 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:56.959936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-8c7de328-3fd9-40eb-aea5-601dfde5bc93 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1555 microversion: 2.1 time: 0.169779 Jul 15 17:56:56.959936 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 568/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:56 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:57.975341 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:57.976092 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:57.982771 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:57.983165 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:57.983931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:57.984373 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:58.151281 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:58.160221 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-d9b3de0d-a36b-4319-bb09-d95d8f93740b tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1555 microversion: 2.1 time: 0.188794 Jul 15 17:56:58.161047 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 546/1114] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:57 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:56:58.260330 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-bc23b224-ab13-4b19-b8d6-a4e5af9c6f69 req-a611bb90-050c-4a85-8abb-7a5e822f81b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab8c36a-4919-4819-9ccd-de2c2a23e83f", "name": "network-vif-deleted", "tag": "9fc7d179-ebd6-4dcb-bbff-283282b30071"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:56:58.271350 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-bc23b224-ab13-4b19-b8d6-a4e5af9c6f69 req-a611bb90-050c-4a85-8abb-7a5e822f81b5 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:58.271773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-bc23b224-ab13-4b19-b8d6-a4e5af9c6f69 req-a611bb90-050c-4a85-8abb-7a5e822f81b5 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:58.284979 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-bc23b224-ab13-4b19-b8d6-a4e5af9c6f69 req-a611bb90-050c-4a85-8abb-7a5e822f81b5 service nova] Creating event network-vif-deleted:9fc7d179-ebd6-4dcb-bbff-283282b30071 for instance cab8c36a-4919-4819-9ccd-de2c2a23e83f on hv-cinder-83697 Jul 15 17:56:58.290510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-bc23b224-ab13-4b19-b8d6-a4e5af9c6f69 req-a611bb90-050c-4a85-8abb-7a5e822f81b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034349 Jul 15 17:56:58.291101 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 569/1115] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:56:59.177456 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:56:59.178224 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:56:59.185462 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:59.185917 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:59.186811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:59.187254 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:59.222545 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:56:59.222989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:56:59.223444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.objects.instance [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lazy-loading 'fault' on Instance uuid cab8c36a-4919-4819-9ccd-de2c2a23e83f {{(pid=124745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:56:59.266525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b93d5a1e5b4c46b505cdacf707ee1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c91c6b348e4840939870bf231d5a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:56:59.274057 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4aeb6ef0-7c15-4ea3-b45b-567b14bf40f5 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 200 len: 1348 microversion: 2.1 time: 0.100392 Jul 15 17:56:59.274616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 547/1116] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:56:59 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:00.293612 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:00.294324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] [instance: cab8c36a-4919-4819-9ccd-de2c2a23e83f] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:00.300753 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:00.301204 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:00.301974 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:00.302411 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:00.316752 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] HTTP exception thrown: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f could not be found. Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Request method failure captured: Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f HTTP/1.1 Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0am-CNlSU-mmjssPwUPI_IQi-LR8ggj6OWqMnDAmF9jDs8emKxnn08Xl41-1eY3qFmX57XgCZFUgo7royA-SOM42W5hgj-uC1xuF4k4g78sR0cbKPku7oHy7mBAm4prWu8ko0xl6E98efNGhiYPh5gHKpuP2NBQgkNHR0FmMJXvYors Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: 08c91c6b348e4840939870bf231d5a91 Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-TestMinimumBasicScenario-1602563899 Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 17:57:00.318464 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08c91c6b348e4840939870bf231d5a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08c91c6b348e4840939870bf231d5a91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08c91c6b348e4840939870bf231d5a91", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08c91c6b348e4840939870bf231d5a91"}]}] Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-TestMinimumBasicScenario-1602563899 Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: 08c91c6b348e4840939870bf231d5a91 Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1602563899 Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-TestMinimumBasicScenario-1602563899-project Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 98b93d5a1e5b4c46b505cdacf707ee1a Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-TestMinimumBasicScenario-1602563899-project Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f could not be found. Jul 15 17:57:00.319997 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': 'cab8c36a-4919-4819-9ccd-de2c2a23e83f'} Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f could not be found. Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:57:00.320967 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f could not be found. Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f could not be found. Jul 15 17:57:00.322972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 17:57:00.324336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Returning 404 to user: Instance cab8c36a-4919-4819-9ccd-de2c2a23e83f could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:57:00.324336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1952d394-7217-49b9-8cfd-e8a3b9d72ed2 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f" status: 404 len: 111 microversion: 2.1 time: 0.033569 Jul 15 17:57:00.324336 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 570/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:00 2022] GET /compute/v2.1/servers/cab8c36a-4919-4819-9ccd-de2c2a23e83f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:57:00.329924 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-13bb9905-f7d7-4f82-8708-1940b36749b1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] Calling method '.version_select at 0x7f37d16d3a60>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:00.431240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-13bb9905-f7d7-4f82-8708-1940b36749b1 tempest-TestMinimumBasicScenario-1602563899 tempest-TestMinimumBasicScenario-1602563899-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-399712967" status: 202 len: 0 microversion: 2.1 time: 0.105008 Jul 15 17:57:00.431754 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 548/1118] 10.222.0.57 () {58 vars in 1268 bytes} [Fri Jul 15 17:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-399712967 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 15 17:57:14.729646 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1981786113", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-353692788", "security_groups": [{"name": "tempest-secgroup-smoke-1849405853"}], "block_device_mapping_v2": [{"uuid": "02f1548a-3df5-4013-9593-60ce79fb797b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dee39a4-e611-4677-a6ea-a98694fb4492"}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:57:14.738090 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:14.738759 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:15.002851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] validate_networks() for [('3dee39a4-e611-4677-a6ea-a98694fb4492', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:57:15.366449 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:57:15.366902 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:57:15.367369 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:57:15.367771 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:57:15.368175 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:57:15.377953 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:15.378395 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:15.379181 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:15.379610 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:15.396208 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for project d8dad396aa934856a2d92c7acd786882. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:57:15.400263 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for user 8bc160d6807b4c7daf447ea9837de3f8 and project d8dad396aa934856a2d92c7acd786882. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:57:15.457661 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:57:15.459811 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02f1548a-3df5-4013-9593-60ce79fb797b',volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:57:15.882647 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-d2674026-ee80-4cce-9a17-94ce48135d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.156952 Jul 15 17:57:15.883930 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 571/1119] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:57:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:57:15.891489 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=4 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:15.892296 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=36 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:15.893043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:15.896857 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-60abb272-7897-4936-82fa-34d0da5babd1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:15.898294 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-60abb272-7897-4936-82fa-34d0da5babd1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:16.065641 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-60abb272-7897-4936-82fa-34d0da5babd1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:16.073129 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-60abb272-7897-4936-82fa-34d0da5babd1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1094 microversion: 2.1 time: 0.182963 Jul 15 17:57:16.073688 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 549/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:15 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1094 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:17.091456 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:17.092057 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:17.098314 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:17.098762 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:17.099534 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:17.099971 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:17.164244 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:17.172905 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-a8f188f5-5780-44c7-be0e-d378be7b7546 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1144 microversion: 2.1 time: 0.087021 Jul 15 17:57:17.173466 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 572/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:17 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:18.190055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:18.190674 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:18.198262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:18.198976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:18.199764 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:18.200333 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:18.273886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:18.283663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-3f6bcd93-75d5-4e3a-bd74-5b3975c37d73 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1210 microversion: 2.1 time: 0.097670 Jul 15 17:57:18.284365 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 550/1122] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:18 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:18.673614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 17:57:18.674149 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Fri Jul 15 17:57:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 17:57:19.301120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:19.301747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:19.308364 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:19.308850 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:19.309628 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:19.310060 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:19.448514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:19.456386 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-072d1e0b-26c5-4aa6-8e15-b211316b9b78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1278 microversion: 2.1 time: 0.159075 Jul 15 17:57:19.456986 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 573/1123] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:19 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:20.028441 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-07d892a9-bb01-4366-9e5c-503a022675cb req-dacf597a-f02e-4fe9-bf9e-a843d47d8cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba68791-0df9-4094-9231-bfc97c566bd2", "tag": "70eb8e94-72f7-403e-8452-aeee7cc6380b"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:57:20.036705 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-07d892a9-bb01-4366-9e5c-503a022675cb req-dacf597a-f02e-4fe9-bf9e-a843d47d8cae service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:20.037122 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-07d892a9-bb01-4366-9e5c-503a022675cb req-dacf597a-f02e-4fe9-bf9e-a843d47d8cae service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:20.051755 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-07d892a9-bb01-4366-9e5c-503a022675cb req-dacf597a-f02e-4fe9-bf9e-a843d47d8cae service nova] Creating event network-changed:70eb8e94-72f7-403e-8452-aeee7cc6380b for instance 0ba68791-0df9-4094-9231-bfc97c566bd2 on hv-cinder-83697 Jul 15 17:57:20.057346 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-07d892a9-bb01-4366-9e5c-503a022675cb req-dacf597a-f02e-4fe9-bf9e-a843d47d8cae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032960 Jul 15 17:57:20.057957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 551/1124] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:57:20.472864 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:20.473480 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:20.479956 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:20.480408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:20.481218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:20.481831 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:20.618286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:20.626641 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e9b53f22-83f7-4d6d-83fd-5f1e7565596b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.157588 Jul 15 17:57:20.627206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 574/1125] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:20 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:21.651873 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:21.652580 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:21.659336 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:21.659788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:21.660561 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:21.661048 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:21.795041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:21.802480 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-fc360975-01d5-40ef-a890-6cb53f2dd809 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.155563 Jul 15 17:57:21.803041 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 552/1126] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:21 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:22.819435 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:22.820036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:22.826580 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:22.827021 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:22.827772 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:22.828205 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:22.964574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:22.971968 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0f9f255a-e583-413c-af49-b9e2e3489df8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.156393 Jul 15 17:57:22.972519 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 575/1127] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:22 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:23.989421 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:23.990071 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:23.997435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:23.997913 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:23.998681 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:23.999120 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:24.133989 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:24.143603 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2a5206a0-251e-4098-a32a-4ae81f81e086 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.158179 Jul 15 17:57:24.144171 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 553/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:23 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:25.160780 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:25.161404 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:25.167814 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:25.168260 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:25.169062 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:25.169496 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:25.304851 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:25.312928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0c1538bc-b313-4a78-bcb4-d76b23e4a8db tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.155936 Jul 15 17:57:25.313657 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 576/1129] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:25 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:26.329642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:26.330267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:26.332744 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:26.337595 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:26.338049 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:26.338819 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:26.339256 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:26.467939 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:26.475355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c41866ee-e137-45be-8b28-f32858d69a7a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.149676 Jul 15 17:57:26.475920 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 554/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:26 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:27.492553 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:27.493217 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:27.495542 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:27.496469 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=6 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:57:27.501715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:27.502156 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:27.502941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:27.503371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:27.633323 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:27.641403 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7bef4615-77f0-45d3-b8fd-1719e790bb74 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.152771 Jul 15 17:57:27.642135 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 577/1131] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:27 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:28.663139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:28.663758 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:28.670628 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:28.671077 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:28.682863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:28.682863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:28.813165 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:28.820805 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-872995aa-5bc1-41fb-b553-9ba46662dc1e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.161491 Jul 15 17:57:28.825798 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 555/1132] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:28 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:29.345654 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 17:57:29.345891 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 17:57:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 17:57:29.839072 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:29.839599 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:29.846122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:29.846569 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:29.847335 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:29.847765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:29.982185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:29.989665 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3c900e62-9787-4008-aba6-7a965e627ba6 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.155124 Jul 15 17:57:29.990230 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 578/1133] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:29 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:30.777024 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-32bfb180-e7af-4899-9afb-dfe682d0aa28 req-69ff532a-cdcc-4d83-a1a1-9755e4f1389d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba68791-0df9-4094-9231-bfc97c566bd2", "name": "network-vif-plugged", "status": "completed", "tag": "70eb8e94-72f7-403e-8452-aeee7cc6380b"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:57:30.786064 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-32bfb180-e7af-4899-9afb-dfe682d0aa28 req-69ff532a-cdcc-4d83-a1a1-9755e4f1389d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:30.786515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-32bfb180-e7af-4899-9afb-dfe682d0aa28 req-69ff532a-cdcc-4d83-a1a1-9755e4f1389d service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:30.796640 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-32bfb180-e7af-4899-9afb-dfe682d0aa28 req-69ff532a-cdcc-4d83-a1a1-9755e4f1389d service nova] Creating event network-vif-plugged:70eb8e94-72f7-403e-8452-aeee7cc6380b for instance 0ba68791-0df9-4094-9231-bfc97c566bd2 on hv-cinder-83697 Jul 15 17:57:30.801692 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-32bfb180-e7af-4899-9afb-dfe682d0aa28 req-69ff532a-cdcc-4d83-a1a1-9755e4f1389d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028666 Jul 15 17:57:30.802265 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 556/1134] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:57:31.006735 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:31.007420 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:31.013849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:31.014332 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:31.015093 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:31.015525 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:31.146027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:31.153510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3044ed49-fb34-48e6-843c-34a3d7761911 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.150784 Jul 15 17:57:31.154250 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 579/1135] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:31 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:32.171928 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:32.172668 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:32.178952 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:32.179633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:32.180416 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:32.180887 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:32.311582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:32.319082 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-90648dcd-5861-4c1f-81ad-501d3d115c79 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1266 microversion: 2.1 time: 0.152602 Jul 15 17:57:32.319633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 557/1136] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:32 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:33.336125 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:33.336769 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:33.343634 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:33.344074 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:33.344870 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:33.345307 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:33.479255 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:33.487416 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-97ca767f-e403-480a-b204-f596f20b957b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1452 microversion: 2.1 time: 0.155173 Jul 15 17:57:33.487972 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 580/1137] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:33 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:33.503712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:57:33.504255 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:57:33.510678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:33.511121 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:33.511871 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:33.512510 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:33.644553 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:57:33.651931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-625a4c96-f4ba-496e-a096-4e048b26231b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1452 microversion: 2.1 time: 0.152138 Jul 15 17:57:33.653120 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 558/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:57:33 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:57:35.633180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-6aaa48b9-ca7f-4e99-9819-255068f3368b req-47429843-767c-4990-883f-48d173e0eccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba68791-0df9-4094-9231-bfc97c566bd2", "tag": "70eb8e94-72f7-403e-8452-aeee7cc6380b"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:57:35.641770 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6aaa48b9-ca7f-4e99-9819-255068f3368b req-47429843-767c-4990-883f-48d173e0eccd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:57:35.642216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-6aaa48b9-ca7f-4e99-9819-255068f3368b req-47429843-767c-4990-883f-48d173e0eccd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:57:35.653509 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-6aaa48b9-ca7f-4e99-9819-255068f3368b req-47429843-767c-4990-883f-48d173e0eccd service nova] Creating event network-changed:70eb8e94-72f7-403e-8452-aeee7cc6380b for instance 0ba68791-0df9-4094-9231-bfc97c566bd2 on hv-cinder-83697 Jul 15 17:57:35.658748 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-6aaa48b9-ca7f-4e99-9819-255068f3368b req-47429843-767c-4990-883f-48d173e0eccd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029225 Jul 15 17:57:35.659352 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 581/1139] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:59:33.322876 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5feddb22-53de-4509-9486-23aed78d81c4] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 15 17:59:33.327849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=22 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:33.327849 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=46 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:33.328370 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:33.328891 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:33.334721 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:33.335175 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:33.335940 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:33.336383 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:33.363891 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 17:59:33.661883 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-94e4cc8a-90d6-4dc0-b1d7-ffa14b4de0bb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 204 len: 0 microversion: 2.1 time: 0.340663 Jul 15 17:59:33.662459 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 559/1140] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 17:59:33 2022] DELETE /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 17:59:33.669315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10bb047d-798b-46c4-8db5-6c890cdbb1f9] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 17:59:33.670022 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:33.670761 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=58 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:33.675143 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:33.675846 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:33.681922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:33.682367 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:33.683127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:33.683559 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:33.816374 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:33.824688 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-57fbfb0c-991f-4deb-8788-efbd0b3a7b97 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1577 microversion: 2.1 time: 0.157176 Jul 15 17:59:33.825264 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 582/1141] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:33 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:34.842965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:34.843663 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:34.852321 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:34.852814 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:34.853590 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:34.854036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:34.859518 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] [5feddb22-53de-4509-9486-23aed78d81c4] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 51066. Jul 15 17:59:34.987384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:34.995851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9659ca2d-b566-4d50-b655-da67b9b37e5a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1577 microversion: 2.1 time: 0.157141 Jul 15 17:59:34.996515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 560/1142] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:34 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:36.013827 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:36.014510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:36.022315 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:36.022765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:36.023544 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:36.023980 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:36.044529 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] [10bb047d-798b-46c4-8db5-6c890cdbb1f9] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 51070. Jul 15 17:59:36.162098 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:36.170515 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c1e43e44-753c-4786-a021-fdd0c726306b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1577 microversion: 2.1 time: 0.161504 Jul 15 17:59:36.171573 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 583/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:36 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:36.510657 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-f2b4e647-8197-4b3a-89ee-4ac7f7dbc375 req-d17707e5-05d7-46ed-8c2b-381f86e721bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba68791-0df9-4094-9231-bfc97c566bd2", "name": "network-vif-deleted", "tag": "70eb8e94-72f7-403e-8452-aeee7cc6380b"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:59:36.523507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-f2b4e647-8197-4b3a-89ee-4ac7f7dbc375 req-d17707e5-05d7-46ed-8c2b-381f86e721bd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:36.528364 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-f2b4e647-8197-4b3a-89ee-4ac7f7dbc375 req-d17707e5-05d7-46ed-8c2b-381f86e721bd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:36.540253 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-f2b4e647-8197-4b3a-89ee-4ac7f7dbc375 req-d17707e5-05d7-46ed-8c2b-381f86e721bd service nova] Creating event network-vif-deleted:70eb8e94-72f7-403e-8452-aeee7cc6380b for instance 0ba68791-0df9-4094-9231-bfc97c566bd2 on hv-cinder-83697 Jul 15 17:59:36.546581 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-f2b4e647-8197-4b3a-89ee-4ac7f7dbc375 req-d17707e5-05d7-46ed-8c2b-381f86e721bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103150 Jul 15 17:59:36.547287 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 561/1144] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:59:37.187292 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:37.187912 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:37.194656 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:37.195108 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:37.196498 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:37.196970 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:37.229220 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:37.229800 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:37.230120 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lazy-loading 'fault' on Instance uuid 0ba68791-0df9-4094-9231-bfc97c566bd2 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 17:59:37.273925 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:37.281504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0bb135c4-9877-43ef-a066-8d0e21320dc3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 200 len: 1230 microversion: 2.1 time: 0.098114 Jul 15 17:59:37.282058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 584/1145] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:37 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:38.299091 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:38.299816 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:38.308530 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:38.309013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:38.309793 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:38.310233 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:38.323976 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] HTTP exception thrown: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Request method failure captured: Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 HTTP/1.1 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0apdprf6OOh6S9yqshg8nvAPhYNDQLEhvYu9a5NKjhangKygT-pbSjCfzyQS4JLcpi02Zvc49iihPlGc0MUfI9XuWOAuAyic-J5OIdLrNKIS7dEaJwue86snyt21jk9THaabWtJXI3uCZUJCfb2GCWO_8wj8H6MD0Y055KqPSOCdvr4 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 17:59:38.325634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d8dad396aa934856a2d92c7acd786882", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}] Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-TestVolumeBootPattern-1840120147 Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-TestVolumeBootPattern-1840120147-project Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 8bc160d6807b4c7daf447ea9837de3f8 Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-TestVolumeBootPattern-1840120147-project Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 17:59:38.327343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '0ba68791-0df9-4094-9231-bfc97c566bd2'} Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 17:59:38.328391 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 17:59:38.330039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 17:59:38.331463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Returning 404 to user: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 17:59:38.331463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2641f6fe-ce19-487f-8a3a-5943bd5b9f76 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 404 len: 111 microversion: 2.1 time: 0.032219 Jul 15 17:59:38.331463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 562/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:38 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 17:59:38.373521 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-247844425", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-353692788", "security_groups": [{"name": "tempest-secgroup-smoke-1849405853"}], "block_device_mapping_v2": [{"uuid": "02f1548a-3df5-4013-9593-60ce79fb797b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dee39a4-e611-4677-a6ea-a98694fb4492"}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:59:38.482747 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] validate_networks() for [('3dee39a4-e611-4677-a6ea-a98694fb4492', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 17:59:38.904299 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 17:59:38.904982 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 17:59:38.905965 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 17:59:38.906594 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 17:59:38.907102 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 17:59:38.918547 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:38.921225 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:38.922097 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:38.922539 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:38.945472 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for project d8dad396aa934856a2d92c7acd786882. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 17:59:38.952012 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for user 8bc160d6807b4c7daf447ea9837de3f8 and project d8dad396aa934856a2d92c7acd786882. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 17:59:39.015252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 17:59:39.017494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02f1548a-3df5-4013-9593-60ce79fb797b',volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 17:59:39.485209 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-66aff35d-573f-49c1-a030-ff5a4a07d24c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115343 Jul 15 17:59:39.485840 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 585/1147] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 17:59:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 17:59:39.495954 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b282ddf1-238e-4e03-974f-7fd93a3b69a8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:39.496558 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b282ddf1-238e-4e03-974f-7fd93a3b69a8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:39.553157 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b282ddf1-238e-4e03-974f-7fd93a3b69a8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:39.562467 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b282ddf1-238e-4e03-974f-7fd93a3b69a8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1093 microversion: 2.1 time: 0.068601 Jul 15 17:59:39.563059 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 563/1148] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:39 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:40.580013 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:40.580719 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:40.587528 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:40.587982 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:40.588788 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:40.589228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:40.651774 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:40.659384 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-77867612-1821-4807-863c-a76d692a421e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1143 microversion: 2.1 time: 0.083987 Jul 15 17:59:40.659949 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 586/1149] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:40 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:41.676335 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:41.677678 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:41.685841 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:41.686295 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:41.687081 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:41.687642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:41.757374 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:41.765161 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-ed164dbf-cc94-47b4-a943-f6ae6f77d973 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1199 microversion: 2.1 time: 0.092680 Jul 15 17:59:41.765729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 564/1150] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:41 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:42.782479 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:42.784562 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:42.791807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:42.792251 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:42.793294 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:42.793973 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:42.932804 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:42.941064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e4d06be7-0994-4bc3-8765-174f9605a11b tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1277 microversion: 2.1 time: 0.162419 Jul 15 17:59:42.942113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 587/1151] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:42 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:43.494641 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-a8c4c6da-988b-444d-b59c-8ca5573d4cd4 req-76ecf2f6-6960-4b5a-8f88-f018242dd416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3faf27-a83e-44d1-a56c-ba417f6eba73", "tag": "2d5f4129-2ead-4668-be69-c1ee7998d17e"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:59:43.503577 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-a8c4c6da-988b-444d-b59c-8ca5573d4cd4 req-76ecf2f6-6960-4b5a-8f88-f018242dd416 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:43.504029 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-a8c4c6da-988b-444d-b59c-8ca5573d4cd4 req-76ecf2f6-6960-4b5a-8f88-f018242dd416 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:43.517116 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-a8c4c6da-988b-444d-b59c-8ca5573d4cd4 req-76ecf2f6-6960-4b5a-8f88-f018242dd416 service nova] Creating event network-changed:2d5f4129-2ead-4668-be69-c1ee7998d17e for instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 on hv-cinder-83697 Jul 15 17:59:43.522043 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-a8c4c6da-988b-444d-b59c-8ca5573d4cd4 req-76ecf2f6-6960-4b5a-8f88-f018242dd416 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036010 Jul 15 17:59:43.522889 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 565/1152] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:59:43.958371 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:43.959069 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:43.965613 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:43.966058 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:43.966824 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:43.967257 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:44.098804 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:44.106801 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cf41217f-7a55-4be9-a747-f0af5faac963 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.152338 Jul 15 17:59:44.107376 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 588/1153] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:43 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:45.126525 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:45.127259 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:45.133959 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:45.136055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:45.136055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:45.136055 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:45.271772 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:45.279298 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-620374d7-25b3-4538-acc6-eac138fde6d0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.157845 Jul 15 17:59:45.279863 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 566/1154] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:45 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:46.296452 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:46.297089 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:46.303504 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:46.303945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:46.304750 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:46.305206 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:46.441159 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:46.448451 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-3d79192d-8f15-44ec-b323-a5f91ab6df8e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.155782 Jul 15 17:59:46.449037 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 589/1155] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:46 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:47.465178 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:47.465839 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:47.472449 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:47.472941 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:47.473740 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:47.474216 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:47.606036 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:47.613446 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-49586c3d-27ce-4f69-bb10-c483d4b48d08 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.152146 Jul 15 17:59:47.614003 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 567/1156] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:47 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:48.631126 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:48.631849 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:48.639337 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:48.639781 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:48.640538 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:48.641000 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:48.772740 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:48.780181 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-0b98be26-da0c-4126-96a4-3dffa6592183 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.152898 Jul 15 17:59:48.780807 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 590/1157] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:48 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:49.797728 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:49.798372 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:49.800819 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=2 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:49.805759 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:49.806220 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:49.807012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:49.807451 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:49.943633 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:49.951683 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-49e9c961-cf58-4db6-b4f3-b3adebe4684f tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.157858 Jul 15 17:59:49.952236 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 568/1158] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:49 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 17:59:50.968703 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:50.969238 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:50.971079 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:50.971733 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=6 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:59:50.977691 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:50.978136 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:50.981955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:50.981955 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:51.119922 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:51.127621 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-86311e79-6ba4-4d26-9082-70d14f7fd557 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.162874 Jul 15 17:59:51.128180 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 591/1159] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:50 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:52.145004 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:52.145531 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:52.152562 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:52.153039 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:52.153806 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:52.154242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:52.284267 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:52.292700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-6c80bf9d-b72f-42c8-a494-3e3ff3703eb2 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.151622 Jul 15 17:59:52.293279 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 569/1160] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:52 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:53.309982 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:53.310690 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:53.317676 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:53.318123 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:53.318890 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:53.319324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:53.453503 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:53.461172 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-edabb4b7-29e6-46af-9f6e-0466b0fc5f35 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.154999 Jul 15 17:59:53.461724 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 592/1161] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:53 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:53.576788 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-85698d6f-4848-46c4-a1ec-75e004e90eb8 req-e42c3cdb-e3e0-4cbd-97a7-0f2e54d476bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3faf27-a83e-44d1-a56c-ba417f6eba73", "name": "network-vif-plugged", "status": "completed", "tag": "2d5f4129-2ead-4668-be69-c1ee7998d17e"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:59:53.584662 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-85698d6f-4848-46c4-a1ec-75e004e90eb8 req-e42c3cdb-e3e0-4cbd-97a7-0f2e54d476bd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:53.585104 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-85698d6f-4848-46c4-a1ec-75e004e90eb8 req-e42c3cdb-e3e0-4cbd-97a7-0f2e54d476bd service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:53.595851 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-85698d6f-4848-46c4-a1ec-75e004e90eb8 req-e42c3cdb-e3e0-4cbd-97a7-0f2e54d476bd service nova] Creating event network-vif-plugged:2d5f4129-2ead-4668-be69-c1ee7998d17e for instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 on hv-cinder-83697 Jul 15 17:59:53.600776 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-85698d6f-4848-46c4-a1ec-75e004e90eb8 req-e42c3cdb-e3e0-4cbd-97a7-0f2e54d476bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084298 Jul 15 17:59:53.601340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 570/1162] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 17:59:54.478248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:54.478875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:54.485408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:54.485863 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:54.486622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:54.487050 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:54.622641 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:54.630379 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c0eda6ca-d3bd-4157-93d5-c2851d823476 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1265 microversion: 2.1 time: 0.155987 Jul 15 17:59:54.630948 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 593/1163] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:54 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:55.652822 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:55.653528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:55.659735 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:55.661332 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:55.661332 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:55.661512 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:55.800094 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:55.807843 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c2d81ce5-c477-45e0-8197-583df7e7da67 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1451 microversion: 2.1 time: 0.160346 Jul 15 17:59:55.808405 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 571/1164] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:55 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:55.824113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 17:59:55.824819 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 17:59:55.831261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:55.831716 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:55.832481 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:55.832943 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:55.965514 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 17:59:55.972963 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-598eb16f-2a25-49ed-9c23-1dcc3d39fa9a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1451 microversion: 2.1 time: 0.153249 Jul 15 17:59:55.973527 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 594/1165] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 17:59:55 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 17:59:58.256528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-b357d8a7-0d68-4169-b371-2169db28b91a req-cd557dec-0851-43c8-a057-c46801953c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3faf27-a83e-44d1-a56c-ba417f6eba73", "tag": "2d5f4129-2ead-4668-be69-c1ee7998d17e"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 17:59:58.265158 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-b357d8a7-0d68-4169-b371-2169db28b91a req-cd557dec-0851-43c8-a057-c46801953c08 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 17:59:58.265597 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-b357d8a7-0d68-4169-b371-2169db28b91a req-cd557dec-0851-43c8-a057-c46801953c08 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 17:59:58.276342 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-b357d8a7-0d68-4169-b371-2169db28b91a req-cd557dec-0851-43c8-a057-c46801953c08 service nova] Creating event network-changed:2d5f4129-2ead-4668-be69-c1ee7998d17e for instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 on hv-cinder-83697 Jul 15 17:59:58.281125 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-b357d8a7-0d68-4169-b371-2169db28b91a req-cd557dec-0851-43c8-a057-c46801953c08 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085600 Jul 15 17:59:58.282005 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 572/1166] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:00:38.682248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:00:38.682911 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Fri Jul 15 18:00:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:00:49.355644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:00:49.356215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:01:50.055312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:01:50.056150 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=76 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:01:50.060197 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2100166226", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-353692788", "security_groups": [{"name": "tempest-secgroup-smoke-1849405853"}], "block_device_mapping_v2": [{"uuid": "66ea9be5-c11b-47e3-9a28-302963e0ff1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dee39a4-e611-4677-a6ea-a98694fb4492"}]}} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:01:50.173631 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.network.neutron [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] validate_networks() for [('3dee39a4-e611-4677-a6ea-a98694fb4492', None, None, None, None, None)] {{(pid=124743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 15 18:01:50.539149 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Flavor limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 15 18:01:50.539566 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Image limits 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 15 18:01:50.540033 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Flavor pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 15 18:01:50.540432 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Image pref 0:0:0 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 15 18:01:50.540880 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.virt.hardware [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 15 18:01:50.550027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:50.550467 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:50.551248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:50.551675 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:50.568088 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for project d8dad396aa934856a2d92c7acd786882. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 15 18:01:50.571823 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.quota [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Getting quotas for user 8bc160d6807b4c7daf447ea9837de3f8 and project d8dad396aa934856a2d92c7acd786882. Resources: {'ram', 'instances', 'cores'} {{(pid=124743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 15 18:01:50.628462 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Going to run 1 instances... {{(pid=124743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 15 18:01:50.630529 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66ea9be5-c11b-47e3-9a28-302963e0ff1f',volume_size=None,volume_type=None)] {{(pid=124743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 15 18:01:51.065115 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-f213f7c6-a2f5-48b8-8d77-319991b6edcc tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.011439 Jul 15 18:01:51.065761 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 595/1167] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 15 18:01:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 15 18:01:51.074544 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5feddb22-53de-4509-9486-23aed78d81c4] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 15 18:01:51.075174 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:01:51.075931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:01:51.080299 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-41bcdaf9-cb4e-4b40-84b1-d04b18675b11 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:51.081052 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-41bcdaf9-cb4e-4b40-84b1-d04b18675b11 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:51.134572 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-41bcdaf9-cb4e-4b40-84b1-d04b18675b11 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:51.141727 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-41bcdaf9-cb4e-4b40-84b1-d04b18675b11 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1094 microversion: 2.1 time: 0.069738 Jul 15 18:01:51.142273 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 573/1168] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:51 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:52.159064 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-540b307d-9582-4992-b4fe-399df3c039d9 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:52.159682 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-540b307d-9582-4992-b4fe-399df3c039d9 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:52.211903 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-540b307d-9582-4992-b4fe-399df3c039d9 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:52.218574 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-540b307d-9582-4992-b4fe-399df3c039d9 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1094 microversion: 2.1 time: 0.063850 Jul 15 18:01:52.219121 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 596/1169] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:52 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:53.235450 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-df0d92de-98b2-4c39-8b0f-c5216ce3c315 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:53.236070 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-df0d92de-98b2-4c39-8b0f-c5216ce3c315 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:53.261125 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] [5feddb22-53de-4509-9486-23aed78d81c4] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 51240. Jul 15 18:01:53.302139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-df0d92de-98b2-4c39-8b0f-c5216ce3c315 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:53.309389 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-df0d92de-98b2-4c39-8b0f-c5216ce3c315 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1094 microversion: 2.1 time: 0.078129 Jul 15 18:01:53.309933 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 574/1170] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:53 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:54.380459 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-658d11bf-2bef-4d03-a094-f6c5f367ef12 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:54.381122 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-658d11bf-2bef-4d03-a094-f6c5f367ef12 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:54.432681 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-658d11bf-2bef-4d03-a094-f6c5f367ef12 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:54.439302 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-658d11bf-2bef-4d03-a094-f6c5f367ef12 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1094 microversion: 2.1 time: 0.117097 Jul 15 18:01:54.439857 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 597/1171] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:54 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:55.456417 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:55.457052 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:55.465021 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:55.465463 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:55.466212 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:55.466644 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:55.527085 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:55.534554 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0302a0aa-10af-4505-87c8-537ed2c960c3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1144 microversion: 2.1 time: 0.082410 Jul 15 18:01:55.535107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 575/1172] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:55 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:56.551987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:56.552587 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:56.560404 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:56.560888 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:56.561668 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:56.562102 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:56.627300 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:56.635861 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-048a24a1-612f-4a3b-b90e-cf8c0d7b93b7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1192 microversion: 2.1 time: 0.088014 Jul 15 18:01:56.636431 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 598/1173] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:56 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:57.655284 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:57.655906 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:57.662521 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:57.663031 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:57.663811 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:57.664249 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:57.748343 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:57.756144 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9e2ae453-16f0-4e87-b723-dc0ec8fcff32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1210 microversion: 2.1 time: 0.104712 Jul 15 18:01:57.756729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 576/1174] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:57 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 15 18:01:58.774312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:58.774928 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:58.781873 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:58.782372 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:58.783146 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:58.783577 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:58.919492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:01:58.928331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-eca734cb-909f-4355-bfd0-b77812e94f0d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.157308 Jul 15 18:01:58.928331 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 599/1175] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:58 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:01:58.967414 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-b00718dd-bc5a-4ad7-a9f3-811a639b9110 req-adebc9d5-6948-42b7-830c-7c4bf465b0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b123741-1614-49b6-989a-ec6c33e04940", "tag": "991b0de7-12b8-42a5-ac90-58e304f78b2f"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:01:58.979642 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-b00718dd-bc5a-4ad7-a9f3-811a639b9110 req-adebc9d5-6948-42b7-830c-7c4bf465b0a7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:58.980087 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-b00718dd-bc5a-4ad7-a9f3-811a639b9110 req-adebc9d5-6948-42b7-830c-7c4bf465b0a7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:58.995379 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-b00718dd-bc5a-4ad7-a9f3-811a639b9110 req-adebc9d5-6948-42b7-830c-7c4bf465b0a7 service nova] Creating event network-changed:991b0de7-12b8-42a5-ac90-58e304f78b2f for instance 9b123741-1614-49b6-989a-ec6c33e04940 on hv-cinder-83697 Jul 15 18:01:59.000760 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-b00718dd-bc5a-4ad7-a9f3-811a639b9110 req-adebc9d5-6948-42b7-830c-7c4bf465b0a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039568 Jul 15 18:01:59.001291 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 577/1176] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:01:59.946408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:01:59.947002 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:01:59.954536 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:59.954987 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:01:59.955763 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:01:59.956192 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:00.090014 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:00.097394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c3474727-e972-4b3b-b25b-a35df740004a tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.156186 Jul 15 18:02:00.097945 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 600/1177] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:01:59 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:01.115564 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:01.116515 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:01.122712 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:01.123159 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:01.123927 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:01.124362 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:01.257185 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:01.264656 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-93f978d9-5d7c-43c8-8c6e-66f70be99c27 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.153813 Jul 15 18:02:01.265215 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 578/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:01 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:02.281342 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:02.281958 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:02.283847 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=2 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:02:02.289261 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:02.289709 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:02.290475 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:02.290910 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:02.422597 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:02.429993 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-cda4f393-9800-4f82-80aa-99f9950a63aa tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.152493 Jul 15 18:02:02.430546 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 601/1179] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:02 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:03.446578 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:03.447191 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:03.449628 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell0:SELECT=4 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:02:03.454551 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:03.454997 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:03.455756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:03.456193 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:03.584916 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:03.592507 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-4f2ff0a7-7dba-424f-b076-5bf265e17311 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.149881 Jul 15 18:02:03.593097 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 579/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:03 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:04.609426 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:04.610029 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:04.612324 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell0:SELECT=10 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:02:04.617422 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:04.623523 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:04.623523 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:04.623523 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:04.749216 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:04.757246 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-94f70def-9d3c-4a56-a643-7684fc9b2dc4 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.151251 Jul 15 18:02:04.757825 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 602/1181] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:04 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:05.773988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:05.774588 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:05.781240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:05.781689 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:05.782454 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:05.782957 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:05.914695 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:05.922089 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c67b1567-839d-438c-aa94-2c91e1d6340c tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.152074 Jul 15 18:02:05.922651 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 580/1182] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:05 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:06.940285 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:06.940941 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:06.947595 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:06.948036 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:06.948825 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:06.949259 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:07.100309 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:07.107933 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-032a7909-2580-4721-b31e-e348656b5b64 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.171549 Jul 15 18:02:07.108492 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 603/1183] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:06 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:08.125554 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:08.126384 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:08.133616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:08.134164 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:08.134936 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:08.135368 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:08.268634 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:08.276422 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-8827e539-6f61-4293-8561-cb1d9e726996 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.154983 Jul 15 18:02:08.277014 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 581/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:08 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:09.292494 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:09.293146 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:09.299886 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:09.300490 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:09.301290 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:09.301730 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:09.436781 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:09.445505 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-1c57bcbc-5c20-4d53-b639-c6dc34986e78 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.156827 Jul 15 18:02:09.446071 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 604/1185] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:09 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:10.160114 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-7b4e32a2-4461-40d2-ae5a-6277cc41506b req-cb49451a-4f5e-4adc-a449-072da8c531d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b123741-1614-49b6-989a-ec6c33e04940", "name": "network-vif-plugged", "status": "completed", "tag": "991b0de7-12b8-42a5-ac90-58e304f78b2f"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:02:10.168937 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-7b4e32a2-4461-40d2-ae5a-6277cc41506b req-cb49451a-4f5e-4adc-a449-072da8c531d7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:10.169386 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-7b4e32a2-4461-40d2-ae5a-6277cc41506b req-cb49451a-4f5e-4adc-a449-072da8c531d7 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:10.180106 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-7b4e32a2-4461-40d2-ae5a-6277cc41506b req-cb49451a-4f5e-4adc-a449-072da8c531d7 service nova] Creating event network-vif-plugged:991b0de7-12b8-42a5-ac90-58e304f78b2f for instance 9b123741-1614-49b6-989a-ec6c33e04940 on hv-cinder-83697 Jul 15 18:02:10.184992 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-7b4e32a2-4461-40d2-ae5a-6277cc41506b req-cb49451a-4f5e-4adc-a449-072da8c531d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028996 Jul 15 18:02:10.185566 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 582/1186] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:02:10.462879 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:10.463488 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:10.469995 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:10.470438 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:10.471196 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:10.471626 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:10.606875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:10.614587 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-e7bc62a9-f7e0-4dc4-8e13-20d37f5da386 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.156383 Jul 15 18:02:10.615168 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 605/1187] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:10 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:11.633234 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:11.633934 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:11.640196 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:11.640662 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:11.641421 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:11.641850 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:11.778988 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:11.786762 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c62e4125-b2fa-4846-8cd1-f343de96cea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1266 microversion: 2.1 time: 0.158316 Jul 15 18:02:11.787325 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 583/1188] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:11 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:12.804622 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:12.805241 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:12.811696 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:12.812136 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:12.812915 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:12.813344 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:12.944162 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:12.951715 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-7542922c-719f-4e85-ba37-547a40037974 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1453 microversion: 2.1 time: 0.151596 Jul 15 18:02:12.952280 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 606/1189] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:12 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:12.967438 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:02:12.968054 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:02:12.974658 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:12.975593 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:12.976359 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:12.976825 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:13.108746 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:02:13.116541 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-9b3f009e-864a-4e22-970e-74b6c6ba5524 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1453 microversion: 2.1 time: 0.152933 Jul 15 18:02:13.118538 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 584/1190] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:02:12 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:02:15.547083 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b123741-1614-49b6-989a-ec6c33e04940", "tag": "991b0de7-12b8-42a5-ac90-58e304f78b2f"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:02:15.556581 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:02:15.557291 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:02:15.572495 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] Creating event network-changed:991b0de7-12b8-42a5-ac90-58e304f78b2f for instance 9b123741-1614-49b6-989a-ec6c33e04940 on hv-cinder-83697 Jul 15 18:02:15.576308 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR oslo.messaging._drivers.impl_rabbit [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] [d4342e7b-6334-4fa6-96d7-c9c8f562e11a] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 15 18:02:16.582989 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] [d4342e7b-6334-4fa6-96d7-c9c8f562e11a] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 51298. Jul 15 18:02:16.587041 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-d765c92e-b28b-41e3-b7de-a72510fe9c24 req-c2cd78c4-63f0-4733-8872-88d313e0a883 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043866 Jul 15 18:02:16.587704 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 607/1191] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:02:18.358495 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:02:18.363435 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:02:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:03:55.437075 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_api:SELECT=28 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:03:55.438555 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG dbcounter [-] [124745] Writing DB stats nova_cell1:SELECT=52 {{(pid=124745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:03:55.440186 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:03:55.441499 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG dbcounter [-] [124743] Writing DB stats nova_cell1:SELECT=58 {{(pid=124743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 18:03:55.443187 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:03:55.443690 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:03:55.451461 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:55.457980 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:55.458127 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-ffa4bf0d-d376-4007-9567-27f56702990f req-5abddbe8-dbda-45d6-8bc2-2ea4ad9e81aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b123741-1614-49b6-989a-ec6c33e04940", "tag": "991b0de7-12b8-42a5-ac90-58e304f78b2f"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:03:55.458261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:55.458261 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:55.462465 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-ffa4bf0d-d376-4007-9567-27f56702990f req-5abddbe8-dbda-45d6-8bc2-2ea4ad9e81aa service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:55.463040 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-ffa4bf0d-d376-4007-9567-27f56702990f req-5abddbe8-dbda-45d6-8bc2-2ea4ad9e81aa service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:55.476248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-ffa4bf0d-d376-4007-9567-27f56702990f req-5abddbe8-dbda-45d6-8bc2-2ea4ad9e81aa service nova] Creating event network-changed:991b0de7-12b8-42a5-ac90-58e304f78b2f for instance 9b123741-1614-49b6-989a-ec6c33e04940 on hv-cinder-83697 Jul 15 18:03:55.482797 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-ffa4bf0d-d376-4007-9567-27f56702990f req-5abddbe8-dbda-45d6-8bc2-2ea4ad9e81aa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045076 Jul 15 18:03:55.483785 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 608/1192] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:03:55.492886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Going to try to terminate instance {{(pid=124745) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 18:03:55.773760 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-7c278cfc-c30b-47b8-b07d-c660f2dcbe32 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 204 len: 0 microversion: 2.1 time: 0.338694 Jul 15 18:03:55.774621 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 585/1193] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 18:03:55 2022] DELETE /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 18:03:55.783231 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:03:55.784027 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:03:55.793799 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:55.794256 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:55.795038 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:55.795563 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:56.037348 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:03:56.045510 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-5351068a-bc35-43b2-b06a-6db528739de3 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1577 microversion: 2.1 time: 0.266486 Jul 15 18:03:56.046073 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 609/1194] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:03:55 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:03:57.064792 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:03:57.065492 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:03:57.072700 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:57.073152 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:57.073907 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:57.074340 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:57.352402 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:03:57.360228 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-59203d4d-da3b-49cf-9fbb-840ca8992ca0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1577 microversion: 2.1 time: 0.299680 Jul 15 18:03:57.360821 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 586/1195] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:03:57 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1577 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:03:58.177113 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-cc7f8c1f-70f7-4369-b2d3-8fe838721397 req-f21b07a0-3dfa-4e38-9d7a-e038b496a645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b123741-1614-49b6-989a-ec6c33e04940", "name": "network-vif-deleted", "tag": "991b0de7-12b8-42a5-ac90-58e304f78b2f"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:03:58.188639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-cc7f8c1f-70f7-4369-b2d3-8fe838721397 req-f21b07a0-3dfa-4e38-9d7a-e038b496a645 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:58.188639 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-cc7f8c1f-70f7-4369-b2d3-8fe838721397 req-f21b07a0-3dfa-4e38-9d7a-e038b496a645 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:58.200185 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-cc7f8c1f-70f7-4369-b2d3-8fe838721397 req-f21b07a0-3dfa-4e38-9d7a-e038b496a645 service nova] Creating event network-vif-deleted:991b0de7-12b8-42a5-ac90-58e304f78b2f for instance 9b123741-1614-49b6-989a-ec6c33e04940 on hv-cinder-83697 Jul 15 18:03:58.205248 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-cc7f8c1f-70f7-4369-b2d3-8fe838721397 req-f21b07a0-3dfa-4e38-9d7a-e038b496a645 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031738 Jul 15 18:03:58.205868 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 610/1196] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:03:58.377320 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:03:58.378012 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:03:58.384959 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:58.385355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:58.386130 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:58.386569 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:58.454107 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:03:58.462616 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-2d4cafbc-3fb9-4800-9f49-774ad27894cb tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1225 microversion: 2.1 time: 0.088900 Jul 15 18:03:58.463355 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 587/1197] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:03:58 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:03:58.690560 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:03:58.690808 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Fri Jul 15 18:03:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:03:59.482765 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:03:59.483453 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:03:59.490123 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:59.490690 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:59.491501 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:59.491952 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:59.529441 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:03:59.529890 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:03:59.530339 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lazy-loading 'fault' on Instance uuid 9b123741-1614-49b6-989a-ec6c33e04940 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 18:03:59.572483 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:03:59.580042 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-874096b6-8866-46cb-94c0-1230faf007f1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 200 len: 1230 microversion: 2.1 time: 0.103736 Jul 15 18:03:59.580614 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 611/1198] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:03:59 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:04:00.597756 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:00.598370 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 9b123741-1614-49b6-989a-ec6c33e04940] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:00.605488 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:00.605942 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:00.606720 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:00.607156 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:00.621367 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] HTTP exception thrown: Instance 9b123741-1614-49b6-989a-ec6c33e04940 could not be found. Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Request method failure captured: Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 HTTP/1.1 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0apdprf6OOh6S9yqshg8nvAPhYNDQLEhvYu9a5NKjhangKygT-pbSjCfzyQS4JLcpi02Zvc49iihPlGc0MUfI9XuWOAuAyic-J5OIdLrNKIS7dEaJwue86snyt21jk9THaabWtJXI3uCZUJCfb2GCWO_8wj8H6MD0Y055KqPSOCdvr4 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 18:04:00.622985 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d8dad396aa934856a2d92c7acd786882", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}] Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 8bc160d6807b4c7daf447ea9837de3f8 Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 9b123741-1614-49b6-989a-ec6c33e04940 could not be found. Jul 15 18:04:00.624807 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '9b123741-1614-49b6-989a-ec6c33e04940'} Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b123741-1614-49b6-989a-ec6c33e04940 could not be found. Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 18:04:00.626013 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b123741-1614-49b6-989a-ec6c33e04940 could not be found. Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b123741-1614-49b6-989a-ec6c33e04940 could not be found. Jul 15 18:04:00.627748 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:00.629613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Returning 404 to user: Instance 9b123741-1614-49b6-989a-ec6c33e04940 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 18:04:00.629613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-5e9186a0-9b12-4be5-a548-92da540ee792 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940" status: 404 len: 111 microversion: 2.1 time: 0.030536 Jul 15 18:04:00.629613 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 588/1199] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:00 2022] GET /compute/v2.1/servers/9b123741-1614-49b6-989a-ec6c33e04940 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 18:04:04.099015 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:04.099754 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:04.101271 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [req-4f3dbd83-47ca-4fc9-b6e1-5a079f5bd387 req-55c68b97-8199-454c-88ae-ef3151b9e8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3faf27-a83e-44d1-a56c-ba417f6eba73", "tag": "2d5f4129-2ead-4668-be69-c1ee7998d17e"}]} {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:04:04.107218 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:04.107663 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:04.109104 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:04.109550 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:04.110259 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-4f3dbd83-47ca-4fc9-b6e1-5a079f5bd387 req-55c68b97-8199-454c-88ae-ef3151b9e8a8 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:04.110707 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [req-4f3dbd83-47ca-4fc9-b6e1-5a079f5bd387 req-55c68b97-8199-454c-88ae-ef3151b9e8a8 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:04.122886 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.compute.server_external_events [req-4f3dbd83-47ca-4fc9-b6e1-5a079f5bd387 req-55c68b97-8199-454c-88ae-ef3151b9e8a8 service nova] Creating event network-changed:2d5f4129-2ead-4668-be69-c1ee7998d17e for instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 on hv-cinder-83697 Jul 15 18:04:04.128479 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [req-4f3dbd83-47ca-4fc9-b6e1-5a079f5bd387 req-55c68b97-8199-454c-88ae-ef3151b9e8a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034481 Jul 15 18:04:04.133901 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 589/1200] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:04:04.142066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Going to try to terminate instance {{(pid=124743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 15 18:04:04.478890 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-08969b79-777a-4fe2-806e-d7788a7cc0b8 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 204 len: 0 microversion: 2.1 time: 0.387437 Jul 15 18:04:04.482766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 612/1201] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 18:04:04 2022] DELETE /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 15 18:04:04.489829 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:04.491661 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:04.500217 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:04.501209 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:04.502000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:04.502930 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:04.668096 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:04:04.675620 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-0de1c43e-d20d-4816-8d30-b2df3765aac0 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1576 microversion: 2.1 time: 0.190848 Jul 15 18:04:04.676183 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 590/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:04 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:04:05.693316 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:05.694009 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:05.700552 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:05.701024 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:05.701875 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:05.702312 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:05.842227 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:04:05.851653 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-c364f6c9-b5c1-4329-8d1f-135cfa9b092d tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1576 microversion: 2.1 time: 0.162426 Jul 15 18:04:05.852454 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 613/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:05 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:04:06.869240 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:06.869860 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:06.876729 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:06.877181 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:06.877955 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:06.878130 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [req-f3111bcc-098e-484f-93da-8effd86b38b6 req-18e8cb54-543e-42c5-b70b-435e9ad75699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3faf27-a83e-44d1-a56c-ba417f6eba73", "name": "network-vif-deleted", "tag": "2d5f4129-2ead-4668-be69-c1ee7998d17e"}]} {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 15 18:04:06.878612 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:06.887773 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-f3111bcc-098e-484f-93da-8effd86b38b6 req-18e8cb54-543e-42c5-b70b-435e9ad75699 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:06.888212 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [req-f3111bcc-098e-484f-93da-8effd86b38b6 req-18e8cb54-543e-42c5-b70b-435e9ad75699 service nova] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:06.900394 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.compute.server_external_events [req-f3111bcc-098e-484f-93da-8effd86b38b6 req-18e8cb54-543e-42c5-b70b-435e9ad75699 service nova] Creating event network-vif-deleted:2d5f4129-2ead-4668-be69-c1ee7998d17e for instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 on hv-cinder-83697 Jul 15 18:04:06.908044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [req-f3111bcc-098e-484f-93da-8effd86b38b6 req-18e8cb54-543e-42c5-b70b-435e9ad75699 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031664 Jul 15 18:04:06.908044 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 614/1204] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 15 18:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 15 18:04:06.942582 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.policy [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124745) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:04:06.950749 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-b281608f-9ef0-4b09-942f-f5bf98564383 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1389 microversion: 2.1 time: 0.085466 Jul 15 18:04:06.951306 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 591/1205] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:06 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:04:07.969512 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:07.970228 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:07.976568 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:07.977066 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:07.977826 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:07.978252 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:08.011520 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:08.011961 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:08.012400 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.objects.instance [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lazy-loading 'fault' on Instance uuid ab3faf27-a83e-44d1-a56c-ba417f6eba73 {{(pid=124743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 15 18:04:08.057603 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.policy [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc160d6807b4c7daf447ea9837de3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8dad396aa934856a2d92c7acd786882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124743) authorize /opt/stack/nova/nova/policy.py:199}} Jul 15 18:04:08.061979 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-962161ed-f836-4fcd-a84b-64f951b88f69 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 200 len: 1229 microversion: 2.1 time: 0.097139 Jul 15 18:04:08.062543 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 615/1206] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:07 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 15 18:04:09.079552 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:09.080164 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: ab3faf27-a83e-44d1-a56c-ba417f6eba73] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:09.087410 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:09.087859 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:09.088649 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:09.089262 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:09.106494 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] HTTP exception thrown: Instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 could not be found. Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Request method failure captured: Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 HTTP/1.1 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0apdprf6OOh6S9yqshg8nvAPhYNDQLEhvYu9a5NKjhangKygT-pbSjCfzyQS4JLcpi02Zvc49iihPlGc0MUfI9XuWOAuAyic-J5OIdLrNKIS7dEaJwue86snyt21jk9THaabWtJXI3uCZUJCfb2GCWO_8wj8H6MD0Y055KqPSOCdvr4 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 18:04:09.108139 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d8dad396aa934856a2d92c7acd786882", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}] Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 8bc160d6807b4c7daf447ea9837de3f8 Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 could not be found. Jul 15 18:04:09.109931 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': 'ab3faf27-a83e-44d1-a56c-ba417f6eba73'} Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 could not be found. Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 18:04:09.111111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 could not be found. Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 could not be found. Jul 15 18:04:09.112834 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.114923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Returning 404 to user: Instance ab3faf27-a83e-44d1-a56c-ba417f6eba73 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 18:04:09.114923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-998d38b4-94ae-44fd-8d52-42a17703791e tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73" status: 404 len: 111 microversion: 2.1 time: 0.033916 Jul 15 18:04:09.114923 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 592/1207] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:09 2022] GET /compute/v2.1/servers/ab3faf27-a83e-44d1-a56c-ba417f6eba73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 18:04:09.363662 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:04:09.366882 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:04:09.632820 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:09.634226 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.compute.api [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124743) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:09.639751 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:09.640201 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:09.641005 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:09.641439 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG oslo_concurrency.lockutils [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:09.655098 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.wsgi [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] HTTP exception thrown: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Request method failure captured: Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: request: DELETE /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 HTTP/1.1 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept: application/json Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Accept-Encoding: identity Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Connection: close Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Length: 0 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Content-Type: application/json Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Host: 10.222.0.57 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Openstack-System-Scope: None Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: User-Agent: python-urllib3/1.26.9 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Auth-Token: gAAAAABi0apdprf6OOh6S9yqshg8nvAPhYNDQLEhvYu9a5NKjhangKygT-pbSjCfzyQS4JLcpi02Zvc49iihPlGc0MUfI9XuWOAuAyic-J5OIdLrNKIS7dEaJwue86snyt21jk9THaabWtJXI3uCZUJCfb2GCWO_8wj8H6MD0Y055KqPSOCdvr4 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Id: None Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Domain-Name: None Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Identity-Status: Confirmed Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Is-Admin-Project: True Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Id: default Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Domain-Name: Default Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Project-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Role: reader,member Jul 15 18:04:09.656862 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Roles: reader,member Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d8dad396aa934856a2d92c7acd786882", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}] Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Id: default Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Domain-Name: Default Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Id: 8bc160d6807b4c7daf447ea9837de3f8 Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: X-User-Name: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: method: > Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: exception: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.659766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: action_args: {'id': '0ba68791-0df9-4094-9231-bfc97c566bd2'} Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 18:04:09.661766 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.664408 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.669671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Returning 404 to user: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. {{(pid=124743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 18:04:09.669671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-495a5dd8-e4ed-4389-ab75-b6ace455be39 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 404 len: 111 microversion: 2.1 time: 0.029542 Jul 15 18:04:09.669671 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 616/1208] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 15 18:04:09 2022] DELETE /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 18:04:09.669965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '>' {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:09.669965 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.compute.api [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] [instance: 0ba68791-0df9-4094-9231-bfc97c566bd2] Fetching instance by UUID {{(pid=124745) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 15 18:04:09.674419 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:09.674879 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:09.675672 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 15 18:04:09.676111 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG oslo_concurrency.lockutils [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Lock "f200e8f4-cedd-42b3-a7df-f4992185efad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 15 18:04:09.691794 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.wsgi [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] HTTP exception thrown: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Request method failure captured: Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: request: GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 HTTP/1.1 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept: application/json Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Accept-Encoding: identity Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Connection: close Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Length: 0 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Content-Type: application/json Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Host: 10.222.0.57 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Openstack-System-Scope: None Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: User-Agent: python-urllib3/1.26.9 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Auth-Token: gAAAAABi0apdprf6OOh6S9yqshg8nvAPhYNDQLEhvYu9a5NKjhangKygT-pbSjCfzyQS4JLcpi02Zvc49iihPlGc0MUfI9XuWOAuAyic-J5OIdLrNKIS7dEaJwue86snyt21jk9THaabWtJXI3uCZUJCfb2GCWO_8wj8H6MD0Y055KqPSOCdvr4 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Id: None Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Domain-Name: None Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Identity-Status: Confirmed Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Is-Admin-Project: True Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Id: default Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Domain-Name: Default Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Project-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Role: reader,member Jul 15 18:04:09.693638 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Roles: reader,member Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d8dad396aa934856a2d92c7acd786882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d8dad396aa934856a2d92c7acd786882", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d8dad396aa934856a2d92c7acd786882"}]}] Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Id: d8dad396aa934856a2d92c7acd786882 Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1840120147 Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Id: default Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Domain-Name: Default Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Id: 8bc160d6807b4c7daf447ea9837de3f8 Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: X-User-Name: tempest-TestVolumeBootPattern-1840120147-project Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: method: > Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: exception: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.695444 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: action_args: {'id': '0ba68791-0df9-4094-9231-bfc97c566bd2'} Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: {{(pid=124745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 15 18:04:09.696524 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. Jul 15 18:04:09.701528 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: ERROR nova.api.openstack.wsgi Jul 15 18:04:09.702986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: DEBUG nova.api.openstack.wsgi [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Returning 404 to user: Instance 0ba68791-0df9-4094-9231-bfc97c566bd2 could not be found. {{(pid=124745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 15 18:04:09.702986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO nova.api.openstack.requestlog [None req-c6c98cb9-0a48-416f-b5ff-f66b14d18ea7 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2" status: 404 len: 111 microversion: 2.1 time: 0.032056 Jul 15 18:04:09.702986 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: [pid: 124745|app: 0|req: 593/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 15 18:04:09 2022] GET /compute/v2.1/servers/0ba68791-0df9-4094-9231-bfc97c566bd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 15 18:04:11.220301 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: DEBUG nova.api.openstack.wsgi [None req-79de5b1c-04a9-4cbc-9327-76e00bb248b1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] Calling method '.version_select at 0x7f37d192c820>' {{(pid=124743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 15 18:04:11.325032 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO nova.api.openstack.requestlog [None req-79de5b1c-04a9-4cbc-9327-76e00bb248b1 tempest-TestVolumeBootPattern-1840120147 tempest-TestVolumeBootPattern-1840120147-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-353692788" status: 202 len: 0 microversion: 2.1 time: 0.108481 Jul 15 18:04:11.325611 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: [pid: 124743|app: 0|req: 617/1210] 10.222.0.57 () {58 vars in 1259 bytes} [Fri Jul 15 18:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-353692788 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 15 18:05:38.367134 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:05:38.367728 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:07:18.700471 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:07:18.701286 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Fri Jul 15 18:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:07:29.376000 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:07:29.376516 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:07:31.588660 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:07:31.589211 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Fri Jul 15 18:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:08:58.375058 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:08:58.375672 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:08:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:09:22.055968 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:09:22.056585 dv-cinder-836973-11-iscsi devstack@n-api.service[124743]: Fri Jul 15 18:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 15 18:09:33.350767 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 15 18:09:33.351242 dv-cinder-836973-11-iscsi devstack@n-api.service[124745]: Fri Jul 15 18:09:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!